Jul 07 06:57:02.263167 ip-10-0-138-175 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 06:57:02.263178 ip-10-0-138-175 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 06:57:02.263185 ip-10-0-138-175 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 06:57:02.263401 ip-10-0-138-175 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 06:57:12.453126 ip-10-0-138-175 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 06:57:12.453147 ip-10-0-138-175 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 82b02bdcf796461099a5f77975c5e7b0 -- Jul 07 06:58:46.466857 ip-10-0-138-175 systemd[1]: Starting Kubernetes Kubelet... Jul 07 06:58:46.924674 ip-10-0-138-175 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 06:58:46.924674 ip-10-0-138-175 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 06:58:46.924674 ip-10-0-138-175 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 06:58:46.924674 ip-10-0-138-175 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 06:58:46.924674 ip-10-0-138-175 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 06:58:46.924674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.921806 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925883 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925893 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925897 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925900 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925903 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925906 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925908 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925911 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925913 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925918 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925922 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925926 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925930 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925933 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925936 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925939 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925941 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925944 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:58:46.933080 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925948 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925950 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925953 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925956 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925959 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925961 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925964 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925967 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925970 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925972 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925975 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925978 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925980 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925983 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925986 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925989 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925991 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925994 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925996 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.925999 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:58:46.937078 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926001 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926004 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926007 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926010 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926012 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926015 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926017 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926020 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926022 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926025 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926028 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926031 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926033 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926036 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926038 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926041 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926043 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926046 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926048 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926050 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:58:47.103936 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926054 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:58:47.000369 ip-10-0-138-175 systemd[1]: Started Kubernetes Kubelet. Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926057 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926059 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926062 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926064 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926067 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926070 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926072 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926075 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926077 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926080 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926083 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926086 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926088 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926091 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926093 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926096 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926098 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926101 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926109 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:58:47.121117 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926112 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926114 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926116 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926119 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926122 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926125 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926129 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926132 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926134 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926137 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926139 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926142 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926144 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926147 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926149 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926153 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926155 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926158 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926161 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:58:47.121822 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926164 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926166 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926926 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926933 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926936 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926939 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926942 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926945 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926948 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926950 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926953 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926956 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926958 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926968 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926971 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926973 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926976 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926979 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926981 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926984 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:58:47.122383 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926986 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926989 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926993 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926995 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.926998 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927001 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927003 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927006 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927009 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927011 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927014 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927017 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927019 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927022 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927024 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927027 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927029 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927032 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927034 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927037 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:58:47.123005 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927039 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927042 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927044 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927047 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927049 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927053 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927062 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927065 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927068 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927070 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927072 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927075 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927077 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927080 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927082 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927085 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927087 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927092 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927096 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:58:47.123635 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927098 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927102 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927105 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927107 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927110 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927113 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927116 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927119 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927121 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927124 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927127 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927129 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927132 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927134 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927136 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927139 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927141 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927144 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927147 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927150 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:58:47.124169 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927160 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927163 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927165 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927168 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927172 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927174 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927177 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927179 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927181 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927184 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927187 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927189 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927193 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927197 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927200 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927202 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927205 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927208 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927211 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:58:47.124785 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927214 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927216 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927219 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927700 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927706 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927709 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927712 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927714 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927717 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927720 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927726 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927729 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927731 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927739 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927742 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927745 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927747 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927750 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927753 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927755 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:58:47.125366 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927758 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927760 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927763 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927766 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927768 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927771 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927775 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927778 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927780 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927783 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927785 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927788 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927790 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927793 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927796 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927798 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927801 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927803 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927806 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927809 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:58:47.125992 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927811 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927814 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927816 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927820 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927823 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927825 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927835 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927838 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927842 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927844 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927847 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927850 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927853 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927856 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927859 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927862 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927864 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927867 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927871 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:58:47.126617 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927873 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927876 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927878 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927881 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927883 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927886 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927888 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927891 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927893 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927896 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927898 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927901 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927903 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927906 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927908 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927911 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927915 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927917 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927920 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927923 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:58:47.127134 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927927 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927930 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927932 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927935 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927937 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927941 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927943 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927946 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927948 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927951 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927953 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927957 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927961 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927964 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927967 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927970 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927973 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927975 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927978 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:58:47.127866 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927981 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927983 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927986 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.927988 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928059 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928065 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928077 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928081 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928085 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928090 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928093 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928097 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928100 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928103 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928107 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928111 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928114 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928116 2565 flags.go:64] FLAG: --cgroup-root="" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928119 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928122 2565 flags.go:64] FLAG: --client-ca-file="" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928125 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928128 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928132 2565 flags.go:64] FLAG: --cluster-domain="" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928135 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 06:58:47.128432 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928139 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928142 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928145 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928149 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928152 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928155 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928158 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928161 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928164 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928167 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928170 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928172 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928176 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928179 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928182 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928185 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928188 2565 flags.go:64] FLAG: --enable-server="true" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928191 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928195 2565 flags.go:64] FLAG: --event-burst="100" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928198 2565 flags.go:64] FLAG: --event-qps="50" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928201 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928204 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928207 2565 flags.go:64] FLAG: --eviction-hard="" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928211 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 06:58:47.129121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928214 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928217 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928220 2565 flags.go:64] FLAG: --eviction-soft="" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928222 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928225 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928228 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928231 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928234 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928238 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928241 2565 flags.go:64] FLAG: --feature-gates="" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928244 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928247 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928250 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928253 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928256 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928260 2565 flags.go:64] FLAG: --help="false" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928262 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928265 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928268 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928271 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928274 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928277 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928280 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 06:58:47.129763 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928283 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928285 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928289 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928292 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928295 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928298 2565 flags.go:64] FLAG: --kube-reserved="" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928301 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928303 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928306 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928310 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928313 2565 flags.go:64] FLAG: --lock-file="" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928316 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928319 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928322 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928327 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928330 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928332 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928336 2565 flags.go:64] FLAG: --logging-format="text" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928339 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928342 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928345 2565 flags.go:64] FLAG: --manifest-url="" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928348 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928352 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928355 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928359 2565 flags.go:64] FLAG: --max-pods="110" Jul 07 06:58:47.130385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928362 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928365 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928367 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928370 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928373 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928376 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928379 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928385 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928388 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928392 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928395 2565 flags.go:64] FLAG: --pod-cidr="" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928398 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928403 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928405 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928408 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928411 2565 flags.go:64] FLAG: --port="10250" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928414 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928418 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-009940717e472f0bb" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928421 2565 flags.go:64] FLAG: --qos-reserved="" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928424 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928426 2565 flags.go:64] FLAG: --register-node="true" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928430 2565 flags.go:64] FLAG: --register-with-taints="" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928433 2565 flags.go:64] FLAG: --registry-burst="10" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928436 2565 flags.go:64] FLAG: --registry-qps="5" Jul 07 06:58:47.131043 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928439 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928443 2565 flags.go:64] FLAG: --reserved-memory="" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928447 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928450 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928453 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928456 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928459 2565 flags.go:64] FLAG: --runonce="false" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928461 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928464 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928467 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928470 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928473 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928476 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928479 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928482 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928484 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928487 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928492 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928494 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928497 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928500 2565 flags.go:64] FLAG: --system-cgroups="" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928503 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928508 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928511 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928513 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 06:58:47.131661 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928518 2565 flags.go:64] FLAG: --tls-min-version="" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928521 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928524 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928526 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928529 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928532 2565 flags.go:64] FLAG: --v="2" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928536 2565 flags.go:64] FLAG: --version="false" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928539 2565 flags.go:64] FLAG: --vmodule="" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928544 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.928547 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928708 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928713 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928716 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928719 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928722 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928725 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928728 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928730 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928733 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928735 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928738 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:58:47.132295 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928740 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928743 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928746 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928751 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928754 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928756 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928759 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928762 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928764 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928767 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928769 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928772 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928774 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928778 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928782 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928785 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928788 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928791 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928794 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:58:47.132844 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928798 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928800 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928803 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928806 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928809 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928811 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928814 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928816 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928819 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928821 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928824 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928827 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928829 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928832 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928835 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928837 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928841 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928843 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928846 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:58:47.133343 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928848 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928852 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928855 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928858 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928860 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928863 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928865 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928868 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928872 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928874 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928877 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928879 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928882 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928886 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928888 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928890 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928893 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928896 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928898 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928901 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:58:47.133833 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928903 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928906 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928908 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928911 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928913 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928916 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928918 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928921 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928923 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928927 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928929 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928933 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928936 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928939 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928942 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928945 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928948 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928951 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928953 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:58:47.134321 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928956 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928958 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928961 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928964 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928966 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928969 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928973 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928975 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928978 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928980 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.928983 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.929844 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.937124 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.937139 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.937160 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 06:58:47.134860 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.937166 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937225 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937231 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937234 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937237 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937240 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937243 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937245 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937248 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937251 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937253 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937256 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937258 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937261 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937264 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937266 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937269 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937271 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937275 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:58:47.135249 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937279 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937282 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937284 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937287 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937290 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937293 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937295 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937298 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937300 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937303 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937305 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937310 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937313 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937316 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937318 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937321 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937324 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937326 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937329 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937331 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:58:47.135735 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937334 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937336 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937339 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937341 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937344 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937346 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937349 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937351 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937354 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937356 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937358 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937361 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937365 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937369 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937372 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937374 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937377 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937379 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937382 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937384 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:58:47.136239 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937387 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937389 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937392 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937395 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937399 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937402 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937404 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937407 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937409 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937412 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937414 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937417 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937419 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937422 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937424 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937427 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937429 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937432 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937434 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937437 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:58:47.136757 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937439 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937442 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937444 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937447 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937449 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937452 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937455 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937457 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937460 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937462 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937465 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937467 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937470 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937472 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937475 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937480 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937483 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937491 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937494 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:58:47.137253 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937496 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937500 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.937505 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937659 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937665 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937668 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937672 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937674 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937677 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937680 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937683 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937685 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937688 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937691 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 06:58:47.137734 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937693 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937696 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937699 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937701 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937704 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937706 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937709 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937711 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937714 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937716 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937719 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937721 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937724 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937726 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937730 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937733 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937736 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937744 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937746 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937749 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 06:58:47.138092 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937751 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937754 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937756 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937759 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937761 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937764 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937766 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937769 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937772 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937775 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937777 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937780 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937782 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937785 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937787 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937790 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937792 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937794 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937797 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937800 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 06:58:47.138595 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937802 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937805 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937807 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937810 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937812 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937815 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937819 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937823 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937827 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937830 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937839 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937843 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937846 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937849 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937852 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937855 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937858 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937861 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937863 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 07 06:58:47.139130 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937866 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937869 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937871 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937875 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937878 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937881 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937884 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937886 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937888 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937891 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937893 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937895 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937898 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937900 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937903 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937906 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937908 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937910 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937913 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937916 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 06:58:47.139602 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937921 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937924 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937927 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937929 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937937 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937940 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937942 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937945 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:46.937947 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.937952 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.938050 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.940478 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.942230 2565 server.go:1019] "Starting client certificate rotation" Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.942325 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 06:58:47.140144 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.942359 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 06:58:47.140495 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.945219 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 06:58:47.140495 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.950847 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 06:58:47.140495 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.960008 2565 log.go:25] "Validated CRI v1 runtime API" Jul 07 06:58:47.140495 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.962409 2565 log.go:25] "Validated CRI v1 image API" Jul 07 06:58:47.140495 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.963257 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 06:58:47.140495 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.968457 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7a2d8a07-01f7-4585-a435-08a5a83f9dba:/dev/nvme0n1p3 889a0cdc-a379-4e63-8fed-6207720b9dcb:/dev/nvme0n1p4] Jul 07 06:58:47.140495 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.968471 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.972521 2565 manager.go:216] Machine: {Timestamp:2026-07-07 06:58:46.972066157 +0000 UTC m=+0.397279416 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104423 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a29901c05b546bad5b286a939e8b9 SystemUUID:ec2a2990-1c05-b546-bad5-b286a939e8b9 BootID:82b02bdc-f796-4610-99a5-f77975c5e7b0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:62:36:b8:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:62:36:b8:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:9b:18:5a:d4:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.972638 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.972735 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.976323 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.976352 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.977234 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.977247 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.977255 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.978119 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.979994 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.984702 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.984816 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.985625 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.985636 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.985647 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.985656 2565 kubelet.go:398] "Adding apiserver pod source" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.985664 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 06:58:47.140708 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.986039 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.986060 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.989105 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.989290 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.991756 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.991793 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993888 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993908 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993917 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993934 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993946 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993953 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993968 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993976 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993985 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.993993 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.994013 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.994020 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.995169 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.995196 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.999464 2565 server.go:1268] "Started kubelet" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.999575 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.999571 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:46.999827 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.001366 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-175.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.001441 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.001530 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.001762 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.003120 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.006379 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.008064 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-175.ec2.internal.18bfefb2688eb125 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-175.ec2.internal,UID:ip-10-0-138-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-175.ec2.internal,},FirstTimestamp:2026-07-07 06:58:46.999404837 +0000 UTC m=+0.424618096,LastTimestamp:2026-07-07 06:58:46.999404837 +0000 UTC m=+0.424618096,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-175.ec2.internal,}" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.011126 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.011141 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.011244 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.011907 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.011896 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.011929 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.012037 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.012045 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.012714 2565 factory.go:55] Registering systemd factory Jul 07 06:58:47.141187 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.012730 2565 factory.go:223] Registration of the systemd container factory successfully Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.012940 2565 factory.go:153] Registering CRI-O factory Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.012951 2565 factory.go:223] Registration of the crio container factory successfully Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.012993 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.013011 2565 factory.go:103] Registering Raw factory Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.013024 2565 manager.go:1196] Started watching for new ooms in manager Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.013397 2565 manager.go:349] Starting recovery of all containers Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.016756 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.016832 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.027150 2565 manager.go:354] Recovery completed Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.032348 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.034157 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.034185 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.034198 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.034685 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.034697 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.034713 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.034713 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.035387 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.035408 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.035419 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.036860 2565 policy_none.go:49] "None policy: Start" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.036873 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.036883 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.037414 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-175.ec2.internal.18bfefb26aa12891 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-175.ec2.internal,UID:ip-10-0-138-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-175.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-175.ec2.internal,},FirstTimestamp:2026-07-07 06:58:47.034169489 +0000 UTC m=+0.459382748,LastTimestamp:2026-07-07 06:58:47.034169489 +0000 UTC m=+0.459382748,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-175.ec2.internal,}" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.038852 2565 policy_none.go:47] "Start" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.046518 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8gwf" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.047210 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-175.ec2.internal.18bfefb26aa17ed7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-175.ec2.internal,UID:ip-10-0-138-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-175.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-175.ec2.internal,},FirstTimestamp:2026-07-07 06:58:47.034191575 +0000 UTC m=+0.459404840,LastTimestamp:2026-07-07 06:58:47.034191575 +0000 UTC m=+0.459404840,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-175.ec2.internal,}" Jul 07 06:58:47.142214 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.059205 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8gwf" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.061051 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-175.ec2.internal.18bfefb26aa1c004 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-175.ec2.internal,UID:ip-10-0-138-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-175.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-175.ec2.internal,},FirstTimestamp:2026-07-07 06:58:47.03420826 +0000 UTC m=+0.459421521,LastTimestamp:2026-07-07 06:58:47.03420826 +0000 UTC m=+0.459421521,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-175.ec2.internal,}" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.073123 2565 manager.go:337] "Starting Device Plugin manager" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.073154 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.073164 2565 server.go:87] "Starting device plugin registration server" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.073355 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.073366 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.073487 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.073565 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.073574 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.073990 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.074045 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.126102 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.127225 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.127270 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.127294 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.127337 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 06:58:47.142938 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.129944 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:58:47.173926 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.173897 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:58:47.174829 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.174813 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:58:47.174896 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.174844 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:58:47.174896 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.174853 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:58:47.174896 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.174888 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.184002 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.183988 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.184052 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.184010 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-175.ec2.internal\": node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.200759 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.200706 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.228244 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.228225 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal"] Jul 07 06:58:47.228289 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.228280 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:58:47.232447 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.232435 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:58:47.232491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.232460 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:58:47.232491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.232470 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:58:47.234788 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.234776 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:58:47.234901 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.234887 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.234941 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.234920 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:58:47.235498 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.235485 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:58:47.235557 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.235513 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:58:47.235557 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.235489 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:58:47.235557 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.235529 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:58:47.235557 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.235542 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:58:47.235557 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.235555 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:58:47.237804 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.237792 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.237847 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.237814 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:58:47.238792 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.238769 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:58:47.238849 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.238797 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:58:47.238849 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.238813 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:58:47.268217 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.268198 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-175.ec2.internal\" not found" node="ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.272323 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.272307 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-175.ec2.internal\" not found" node="ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.301687 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.301669 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.313730 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.313710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29eb388a53f1b996afbf5bcbd6cb4dea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal\" (UID: \"29eb388a53f1b996afbf5bcbd6cb4dea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.313802 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.313735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d196a27e053baa6bcb43fbca1f374dc8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-175.ec2.internal\" (UID: \"d196a27e053baa6bcb43fbca1f374dc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.313802 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.313752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29eb388a53f1b996afbf5bcbd6cb4dea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal\" (UID: \"29eb388a53f1b996afbf5bcbd6cb4dea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.402183 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.402119 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.414440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.414422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29eb388a53f1b996afbf5bcbd6cb4dea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal\" (UID: \"29eb388a53f1b996afbf5bcbd6cb4dea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.414489 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.414446 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29eb388a53f1b996afbf5bcbd6cb4dea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal\" (UID: \"29eb388a53f1b996afbf5bcbd6cb4dea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.414489 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.414465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d196a27e053baa6bcb43fbca1f374dc8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-175.ec2.internal\" (UID: \"d196a27e053baa6bcb43fbca1f374dc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.414618 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.414493 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d196a27e053baa6bcb43fbca1f374dc8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-175.ec2.internal\" (UID: \"d196a27e053baa6bcb43fbca1f374dc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.414618 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.414522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29eb388a53f1b996afbf5bcbd6cb4dea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal\" (UID: \"29eb388a53f1b996afbf5bcbd6cb4dea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.414618 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.414531 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29eb388a53f1b996afbf5bcbd6cb4dea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal\" (UID: \"29eb388a53f1b996afbf5bcbd6cb4dea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.502934 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.502852 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.571356 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.571319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.575236 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.575219 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" Jul 07 06:58:47.603691 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.603660 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.704820 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.704794 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.806048 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.805982 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.907095 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:47.907060 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:47.942185 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.942158 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 06:58:47.942760 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:47.942327 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 06:58:48.007640 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:48.007615 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:48.064675 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.064570 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 06:53:47 +0000 UTC" deadline="2028-01-21 12:59:38.438954664 +0000 UTC" Jul 07 06:58:48.064675 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.064631 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13518h0m50.374327803s" Jul 07 06:58:48.085086 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.085059 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 06:58:48.086030 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.086015 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientMemory" Jul 07 06:58:48.086121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.086045 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 06:58:48.086121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.086055 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeHasSufficientPID" Jul 07 06:58:48.108298 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:48.108272 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:48.208629 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:48.208603 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:48.210224 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.210210 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:58:48.305032 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:48.304997 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29eb388a53f1b996afbf5bcbd6cb4dea.slice/crio-0b834fe877bcf6a2ee25f6ffba66dd4870fc628734e959c926634c016bf4300a WatchSource:0}: Error finding container 0b834fe877bcf6a2ee25f6ffba66dd4870fc628734e959c926634c016bf4300a: Status 404 returned error can't find the container with id 0b834fe877bcf6a2ee25f6ffba66dd4870fc628734e959c926634c016bf4300a Jul 07 06:58:48.308746 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:48.308722 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:48.311979 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.311961 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 06:58:48.315356 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:48.315301 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd196a27e053baa6bcb43fbca1f374dc8.slice/crio-d010e87d1dbe28ff0aaa50b6274f82f499bdcc502080220b1fde8bd7ac505794 WatchSource:0}: Error finding container d010e87d1dbe28ff0aaa50b6274f82f499bdcc502080220b1fde8bd7ac505794: Status 404 returned error can't find the container with id d010e87d1dbe28ff0aaa50b6274f82f499bdcc502080220b1fde8bd7ac505794 Jul 07 06:58:48.395956 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.395935 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:58:48.409925 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:48.409901 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:48.510985 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:48.510958 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-175.ec2.internal\" not found" Jul 07 06:58:48.570407 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.570356 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:58:48.611751 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.611728 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" Jul 07 06:58:48.624586 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.624567 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 06:58:48.625442 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.625430 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" Jul 07 06:58:48.640537 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.640521 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 06:58:48.763028 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.763003 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 06:58:48.990038 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.989954 2565 apiserver.go:52] "Watching apiserver" Jul 07 06:58:48.996433 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.996408 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 06:58:48.996987 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.996959 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-6tjjb","kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal","openshift-dns/node-resolver-8hjwm","openshift-multus/multus-additional-cni-plugins-znvk6","openshift-network-diagnostics/network-check-target-pgrb2","openshift-network-operator/iptables-alerter-twmtc","openshift-ovn-kubernetes/ovnkube-node-625xq","kube-system/global-pull-secret-syncer-bfh2d","kube-system/konnectivity-agent-stzn4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw","openshift-cluster-node-tuning-operator/tuned-bxwpx","openshift-image-registry/node-ca-zf7db","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal","openshift-multus/multus-mlzbz"] Jul 07 06:58:48.999925 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:48.999905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.003025 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.002625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.005439 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.004925 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.005439 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.005332 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 06:58:49.005817 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.005795 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 06:58:49.006219 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.006198 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mkjsf\"" Jul 07 06:58:49.006307 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.006224 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 06:58:49.007185 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.006740 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 06:58:49.007185 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.006956 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:58:49.007185 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.007139 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 06:58:49.007406 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.007338 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h9tgt\"" Jul 07 06:58:49.008363 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.008195 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.009727 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.009376 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 06:58:49.009727 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.009621 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 06:58:49.011052 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.010305 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2gfzc\"" Jul 07 06:58:49.011052 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.010502 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 06:58:49.011052 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.010912 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 06:58:49.011685 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.011308 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 06:58:49.011685 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.011619 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:49.011836 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.011763 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:58:49.012142 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.012127 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 06:58:49.014579 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.014486 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 06:58:49.014729 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.014712 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 06:58:49.014926 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.014905 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 06:58:49.015145 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.015128 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 06:58:49.015513 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.015479 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g9xcn\"" Jul 07 06:58:49.018234 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.018215 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.019260 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.019243 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:58:49.019982 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.019966 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.021027 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.020988 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:58:49.021139 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.021090 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 06:58:49.021265 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.021209 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 06:58:49.021706 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.021664 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-74p7f\"" Jul 07 06:58:49.022073 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.021997 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 06:58:49.022418 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.022276 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 06:58:49.022668 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.022625 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tgtgq\"" Jul 07 06:58:49.023140 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.022861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.023140 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.022940 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:58:49.025445 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.025422 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 06:58:49.025875 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.025852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-slash\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.025961 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.025893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-var-lib-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.026065 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.025927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-sys\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.026125 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026091 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9lmj\" (UniqueName: \"kubernetes.io/projected/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-kube-api-access-k9lmj\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.026186 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.026329 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:49.026385 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026365 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-systemd-units\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.026438 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-systemd\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.026577 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-run\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.026638 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-hosts-file\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.026735 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-host-slash\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.026873 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026848 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-node-log\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.026934 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.026894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-run-ovn-kubernetes\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.027082 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.027064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.027210 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.027182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysctl-conf\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.027519 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.027452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-lib-modules\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.027795 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.027545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8mz5\" (UniqueName: \"kubernetes.io/projected/9baf339b-df9a-4068-b99b-5b72a65307c1-kube-api-access-t8mz5\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.027871 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.027828 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bv2tj\"" Jul 07 06:58:49.027871 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.027863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-tmp-dir\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.027997 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.027897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-system-cni-dir\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.028077 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67p44\" (UniqueName: \"kubernetes.io/projected/e429cfcb-16dc-4927-be1a-b2856c65d4dd-kube-api-access-67p44\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.028206 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-run-netns\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.028264 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.028323 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-ovn\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.028435 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.028493 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028447 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-log-socket\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.028554 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-cni-netd\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.028609 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovnkube-script-lib\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.028609 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cnibin\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.028745 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.028745 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-kubelet\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.028745 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028733 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-cni-bin\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.028940 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028898 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-env-overrides\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.029001 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zfx9\" (UniqueName: \"kubernetes.io/projected/5d599faa-3163-4d8d-983b-cb993cc0a8af-kube-api-access-4zfx9\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.029001 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.028987 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 06:58:49.029094 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-modprobe-d\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.029094 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029034 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysconfig\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.029094 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-iptables-alerter-script\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.029391 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysctl-d\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.029462 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029447 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-systemd\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.029520 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-var-lib-kubelet\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.029575 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-host\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.029648 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-tuned\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.029706 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-os-release\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.029836 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.029905 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.029963 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-etc-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.030024 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.029982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-kubernetes\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.030024 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.030015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9baf339b-df9a-4068-b99b-5b72a65307c1-tmp\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.030125 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.030046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovnkube-config\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.030125 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.030080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovn-node-metrics-cert\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.030125 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.030113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg8r7\" (UniqueName: \"kubernetes.io/projected/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-kube-api-access-sg8r7\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.031058 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.031039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:49.031183 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.031144 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:58:49.032642 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.032617 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 06:58:49.032947 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.032930 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttmv9\"" Jul 07 06:58:49.033609 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.033276 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 06:58:49.033609 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.033152 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 06:58:49.035723 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.035084 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.038571 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.037714 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 06:58:49.038571 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.038004 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h92m2\"" Jul 07 06:58:49.038571 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.038233 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 06:58:49.038571 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.038395 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 06:58:49.062266 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.062243 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ghxz7" Jul 07 06:58:49.074626 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.074605 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ghxz7" Jul 07 06:58:49.113632 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.113580 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 06:58:49.130630 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.130387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.130630 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.130439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:49.130630 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.130466 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-systemd-units\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.130630 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.130496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbe3ed12-65a1-4a01-a51f-37ca984cd135-konnectivity-ca\") pod \"konnectivity-agent-stzn4\" (UID: \"dbe3ed12-65a1-4a01-a51f-37ca984cd135\") " pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:58:49.130630 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.130522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.130630 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.130545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-k8s-cni-cncf-io\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.130630 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.130579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8619f98f-805f-4ce7-83e8-8b1de3672e14-kubelet-config\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.131174 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131038 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.131174 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-systemd-units\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8mz5\" (UniqueName: \"kubernetes.io/projected/9baf339b-df9a-4068-b99b-5b72a65307c1-kube-api-access-t8mz5\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-tmp-dir\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-registration-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-os-release\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-socket-dir-parent\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-run-netns\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-log-socket\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131636 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131692 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-run-netns\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-system-cni-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131732 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-log-socket\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cnibin\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131796 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-tmp-dir\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.131809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-kubelet\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-cni-bin\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-env-overrides\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131889 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cnibin\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131893 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-host\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131921 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbe3ed12-65a1-4a01-a51f-37ca984cd135-agent-certs\") pod \"konnectivity-agent-stzn4\" (UID: \"dbe3ed12-65a1-4a01-a51f-37ca984cd135\") " pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131936 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-cni-bin\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131984 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-kubelet\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.131947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-device-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132034 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-host\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-systemd\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-var-lib-kubelet\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-netns\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-daemon-config\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-os-release\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-systemd\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.132677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-kubernetes\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132226 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-var-lib-kubelet\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9baf339b-df9a-4068-b99b-5b72a65307c1-tmp\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovnkube-config\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovn-node-metrics-cert\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132320 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-os-release\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-cni-multus\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-conf-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132413 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-sys\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-cnibin\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c886299-6ad7-401a-8a58-fc1aea3cef70-cni-binary-copy\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132515 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-systemd\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-env-overrides\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-run\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.133508 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8619f98f-805f-4ce7-83e8-8b1de3672e14-dbus\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-host-slash\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132615 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-node-log\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132622 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-run-ovn-kubernetes\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132720 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132735 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysctl-conf\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-lib-modules\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132788 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-kubernetes\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-sys-fs\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-node-log\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-host-slash\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132910 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132931 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-run\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.132950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-systemd\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133004 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysctl-conf\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.134378 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133019 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-lib-modules\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133022 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-run-ovn-kubernetes\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-hosts-file\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-system-cni-dir\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67p44\" (UniqueName: \"kubernetes.io/projected/e429cfcb-16dc-4927-be1a-b2856c65d4dd-kube-api-access-67p44\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-ovn\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-cni-netd\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133215 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovnkube-script-lib\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133280 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e429cfcb-16dc-4927-be1a-b2856c65d4dd-system-cni-dir\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133346 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-sys\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-hosts-file\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-modprobe-d\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133482 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-run-ovn\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovnkube-config\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-cni-netd\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zfx9\" (UniqueName: \"kubernetes.io/projected/5d599faa-3163-4d8d-983b-cb993cc0a8af-kube-api-access-4zfx9\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.135256 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysconfig\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133659 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysctl-d\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js7qg\" (UniqueName: \"kubernetes.io/projected/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-kube-api-access-js7qg\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-modprobe-d\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-kubelet\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysconfig\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133827 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-sysctl-d\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-etc-kubernetes\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qsz9\" (UniqueName: \"kubernetes.io/projected/4c886299-6ad7-401a-8a58-fc1aea3cef70-kube-api-access-2qsz9\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9072c5b-67b1-41cc-80c9-503b7096c72d-host\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.133973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-iptables-alerter-script\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-tuned\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-cni-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134101 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovnkube-script-lib\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-cni-bin\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-multus-certs\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9072c5b-67b1-41cc-80c9-503b7096c72d-serviceca\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.136120 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wf5d\" (UniqueName: \"kubernetes.io/projected/b9072c5b-67b1-41cc-80c9-503b7096c72d-kube-api-access-5wf5d\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-etc-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-socket-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134302 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" event={"ID":"d196a27e053baa6bcb43fbca1f374dc8","Type":"ContainerStarted","Data":"d010e87d1dbe28ff0aaa50b6274f82f499bdcc502080220b1fde8bd7ac505794"} Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-hostroot\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7zrt\" (UniqueName: \"kubernetes.io/projected/e3e6926b-be32-403e-a606-04a5a6d3369b-kube-api-access-s7zrt\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-etc-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-iptables-alerter-script\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg8r7\" (UniqueName: \"kubernetes.io/projected/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-kube-api-access-sg8r7\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-slash\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-var-lib-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9lmj\" (UniqueName: \"kubernetes.io/projected/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-kube-api-access-k9lmj\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134907 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e429cfcb-16dc-4927-be1a-b2856c65d4dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-host-slash\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.137039 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.134970 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5d599faa-3163-4d8d-983b-cb993cc0a8af-var-lib-openvswitch\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.137775 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.137339 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" event={"ID":"29eb388a53f1b996afbf5bcbd6cb4dea","Type":"ContainerStarted","Data":"0b834fe877bcf6a2ee25f6ffba66dd4870fc628734e959c926634c016bf4300a"} Jul 07 06:58:49.139224 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.138853 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9baf339b-df9a-4068-b99b-5b72a65307c1-etc-tuned\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.139224 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.138875 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9baf339b-df9a-4068-b99b-5b72a65307c1-tmp\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.139224 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.138897 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:58:49.139224 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.138922 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:58:49.139224 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.138939 2565 projected.go:196] Error preparing data for projected volume kube-api-access-sjq4g for pod openshift-network-diagnostics/network-check-target-pgrb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:49.139224 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.139029 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g podName:0ecade35-d968-4d62-99fc-ebcf0a17cff8 nodeName:}" failed. No retries permitted until 2026-07-07 06:58:49.638998984 +0000 UTC m=+3.064212259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sjq4g" (UniqueName: "kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g") pod "network-check-target-pgrb2" (UID: "0ecade35-d968-4d62-99fc-ebcf0a17cff8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:49.139224 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.139168 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d599faa-3163-4d8d-983b-cb993cc0a8af-ovn-node-metrics-cert\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.144619 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.144549 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8mz5\" (UniqueName: \"kubernetes.io/projected/9baf339b-df9a-4068-b99b-5b72a65307c1-kube-api-access-t8mz5\") pod \"tuned-bxwpx\" (UID: \"9baf339b-df9a-4068-b99b-5b72a65307c1\") " pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.145862 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.145640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg8r7\" (UniqueName: \"kubernetes.io/projected/d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55-kube-api-access-sg8r7\") pod \"iptables-alerter-twmtc\" (UID: \"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55\") " pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.145862 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.145821 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67p44\" (UniqueName: \"kubernetes.io/projected/e429cfcb-16dc-4927-be1a-b2856c65d4dd-kube-api-access-67p44\") pod \"multus-additional-cni-plugins-znvk6\" (UID: \"e429cfcb-16dc-4927-be1a-b2856c65d4dd\") " pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.146457 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.146410 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9lmj\" (UniqueName: \"kubernetes.io/projected/89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e-kube-api-access-k9lmj\") pod \"node-resolver-8hjwm\" (UID: \"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e\") " pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.146553 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.146473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zfx9\" (UniqueName: \"kubernetes.io/projected/5d599faa-3163-4d8d-983b-cb993cc0a8af-kube-api-access-4zfx9\") pod \"ovnkube-node-625xq\" (UID: \"5d599faa-3163-4d8d-983b-cb993cc0a8af\") " pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.235962 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.235923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-etc-kubernetes\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236217 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.235982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qsz9\" (UniqueName: \"kubernetes.io/projected/4c886299-6ad7-401a-8a58-fc1aea3cef70-kube-api-access-2qsz9\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236217 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-etc-kubernetes\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236217 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236013 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9072c5b-67b1-41cc-80c9-503b7096c72d-host\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.236217 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9072c5b-67b1-41cc-80c9-503b7096c72d-host\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.236217 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-cni-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236217 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-cni-bin\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236217 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-multus-certs\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236217 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-cni-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9072c5b-67b1-41cc-80c9-503b7096c72d-serviceca\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wf5d\" (UniqueName: \"kubernetes.io/projected/b9072c5b-67b1-41cc-80c9-503b7096c72d-kube-api-access-5wf5d\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236273 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-multus-certs\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-cni-bin\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-socket-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-hostroot\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zrt\" (UniqueName: \"kubernetes.io/projected/e3e6926b-be32-403e-a606-04a5a6d3369b-kube-api-access-s7zrt\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbe3ed12-65a1-4a01-a51f-37ca984cd135-konnectivity-ca\") pod \"konnectivity-agent-stzn4\" (UID: \"dbe3ed12-65a1-4a01-a51f-37ca984cd135\") " pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236451 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-hostroot\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-k8s-cni-cncf-io\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8619f98f-805f-4ce7-83e8-8b1de3672e14-kubelet-config\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-registration-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-os-release\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-socket-dir-parent\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.236674 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-system-cni-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbe3ed12-65a1-4a01-a51f-37ca984cd135-agent-certs\") pod \"konnectivity-agent-stzn4\" (UID: \"dbe3ed12-65a1-4a01-a51f-37ca984cd135\") " pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-device-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236745 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-netns\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236762 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9072c5b-67b1-41cc-80c9-503b7096c72d-serviceca\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-daemon-config\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-k8s-cni-cncf-io\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-cni-multus\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-cni-multus\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.236951 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236969 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-socket-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.236992 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-device-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.237026 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs podName:e3e6926b-be32-403e-a606-04a5a6d3369b nodeName:}" failed. No retries permitted until 2026-07-07 06:58:49.737007642 +0000 UTC m=+3.162220906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs") pod "network-metrics-daemon-6tjjb" (UID: "e3e6926b-be32-403e-a606-04a5a6d3369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237038 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-socket-dir-parent\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237085 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-run-netns\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-os-release\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.237491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237134 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8619f98f-805f-4ce7-83e8-8b1de3672e14-kubelet-config\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237139 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-registration-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237139 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dbe3ed12-65a1-4a01-a51f-37ca984cd135-konnectivity-ca\") pod \"konnectivity-agent-stzn4\" (UID: \"dbe3ed12-65a1-4a01-a51f-37ca984cd135\") " pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237181 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-system-cni-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-conf-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-cnibin\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-conf-dir\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c886299-6ad7-401a-8a58-fc1aea3cef70-cni-binary-copy\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8619f98f-805f-4ce7-83e8-8b1de3672e14-dbus\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-sys-fs\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-cnibin\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.237461 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237463 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c886299-6ad7-401a-8a58-fc1aea3cef70-multus-daemon-config\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.237514 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret podName:8619f98f-805f-4ce7-83e8-8b1de3672e14 nodeName:}" failed. No retries permitted until 2026-07-07 06:58:49.737498138 +0000 UTC m=+3.162711408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret") pod "global-pull-secret-syncer-bfh2d" (UID: "8619f98f-805f-4ce7-83e8-8b1de3672e14") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:49.238440 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js7qg\" (UniqueName: \"kubernetes.io/projected/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-kube-api-access-js7qg\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.239335 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237549 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-sys-fs\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.239335 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237567 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.239335 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8619f98f-805f-4ce7-83e8-8b1de3672e14-dbus\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.239335 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-kubelet\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.239335 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c886299-6ad7-401a-8a58-fc1aea3cef70-host-var-lib-kubelet\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.239335 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.237918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c886299-6ad7-401a-8a58-fc1aea3cef70-cni-binary-copy\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.240819 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.240741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dbe3ed12-65a1-4a01-a51f-37ca984cd135-agent-certs\") pod \"konnectivity-agent-stzn4\" (UID: \"dbe3ed12-65a1-4a01-a51f-37ca984cd135\") " pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:58:49.248184 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.248102 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wf5d\" (UniqueName: \"kubernetes.io/projected/b9072c5b-67b1-41cc-80c9-503b7096c72d-kube-api-access-5wf5d\") pod \"node-ca-zf7db\" (UID: \"b9072c5b-67b1-41cc-80c9-503b7096c72d\") " pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.248395 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.248370 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qsz9\" (UniqueName: \"kubernetes.io/projected/4c886299-6ad7-401a-8a58-fc1aea3cef70-kube-api-access-2qsz9\") pod \"multus-mlzbz\" (UID: \"4c886299-6ad7-401a-8a58-fc1aea3cef70\") " pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.248783 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.248702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7zrt\" (UniqueName: \"kubernetes.io/projected/e3e6926b-be32-403e-a606-04a5a6d3369b-kube-api-access-s7zrt\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:49.249885 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.249862 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js7qg\" (UniqueName: \"kubernetes.io/projected/1a1cdd9c-bf80-4ca3-b46a-24f108f63b25-kube-api-access-js7qg\") pod \"aws-ebs-csi-driver-node-xwcrw\" (UID: \"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.321682 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.321650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:58:49.339895 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.339874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" Jul 07 06:58:49.349742 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.349724 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8hjwm" Jul 07 06:58:49.358459 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.358442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-znvk6" Jul 07 06:58:49.366124 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.366105 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twmtc" Jul 07 06:58:49.375826 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.375808 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:58:49.384628 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.384613 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mlzbz" Jul 07 06:58:49.393455 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.393436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" Jul 07 06:58:49.408326 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.408309 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zf7db" Jul 07 06:58:49.640393 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.640326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:49.640532 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.640491 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:58:49.640532 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.640513 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:58:49.640532 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.640522 2565 projected.go:196] Error preparing data for projected volume kube-api-access-sjq4g for pod openshift-network-diagnostics/network-check-target-pgrb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:49.640636 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.640578 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g podName:0ecade35-d968-4d62-99fc-ebcf0a17cff8 nodeName:}" failed. No retries permitted until 2026-07-07 06:58:50.640561227 +0000 UTC m=+4.065774479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjq4g" (UniqueName: "kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g") pod "network-check-target-pgrb2" (UID: "0ecade35-d968-4d62-99fc-ebcf0a17cff8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:49.741106 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.741077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:49.741106 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:49.741110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:49.741366 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.741221 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:49.741366 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.741242 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:49.741366 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.741291 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret podName:8619f98f-805f-4ce7-83e8-8b1de3672e14 nodeName:}" failed. No retries permitted until 2026-07-07 06:58:50.741267355 +0000 UTC m=+4.166480629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret") pod "global-pull-secret-syncer-bfh2d" (UID: "8619f98f-805f-4ce7-83e8-8b1de3672e14") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:49.741366 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:49.741320 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs podName:e3e6926b-be32-403e-a606-04a5a6d3369b nodeName:}" failed. No retries permitted until 2026-07-07 06:58:50.741302715 +0000 UTC m=+4.166515981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs") pod "network-metrics-daemon-6tjjb" (UID: "e3e6926b-be32-403e-a606-04a5a6d3369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:50.078250 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:50.078163 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 06:53:49 +0000 UTC" deadline="2027-12-24 17:47:28.466272357 +0000 UTC" Jul 07 06:58:50.078250 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:50.078201 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12850h48m38.388077295s" Jul 07 06:58:50.333652 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.333626 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89aba0d1_d5cc_41f2_99ee_87ccf30b8e2e.slice/crio-dc339b0753080b6d20e03eea2fa2ee56620c946ea0e1f91c0eb6c1abddf65b02 WatchSource:0}: Error finding container dc339b0753080b6d20e03eea2fa2ee56620c946ea0e1f91c0eb6c1abddf65b02: Status 404 returned error can't find the container with id dc339b0753080b6d20e03eea2fa2ee56620c946ea0e1f91c0eb6c1abddf65b02 Jul 07 06:58:50.335975 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.335488 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe3ed12_65a1_4a01_a51f_37ca984cd135.slice/crio-d561419fff94fca9741f6cd94da5ff01d1a0107a918a18e6d67eb0769092af79 WatchSource:0}: Error finding container d561419fff94fca9741f6cd94da5ff01d1a0107a918a18e6d67eb0769092af79: Status 404 returned error can't find the container with id d561419fff94fca9741f6cd94da5ff01d1a0107a918a18e6d67eb0769092af79 Jul 07 06:58:50.336704 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.336546 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1cdd9c_bf80_4ca3_b46a_24f108f63b25.slice/crio-4e26f1d24fa83820103ecd9ced0b602dfa2b6acfd437d063cda7761ae2e1ee3d WatchSource:0}: Error finding container 4e26f1d24fa83820103ecd9ced0b602dfa2b6acfd437d063cda7761ae2e1ee3d: Status 404 returned error can't find the container with id 4e26f1d24fa83820103ecd9ced0b602dfa2b6acfd437d063cda7761ae2e1ee3d Jul 07 06:58:50.337962 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.337215 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c886299_6ad7_401a_8a58_fc1aea3cef70.slice/crio-6f8c7a349c7600163b53f5c98c8e2f81863a8cbfeb94940a0d42a300f3dcf6a9 WatchSource:0}: Error finding container 6f8c7a349c7600163b53f5c98c8e2f81863a8cbfeb94940a0d42a300f3dcf6a9: Status 404 returned error can't find the container with id 6f8c7a349c7600163b53f5c98c8e2f81863a8cbfeb94940a0d42a300f3dcf6a9 Jul 07 06:58:50.338590 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.338566 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d599faa_3163_4d8d_983b_cb993cc0a8af.slice/crio-e3a1c7f159fb1c9d6d61497f2d0d738d75ec953ec438e0d2ef2b4cf9ae1590e7 WatchSource:0}: Error finding container e3a1c7f159fb1c9d6d61497f2d0d738d75ec953ec438e0d2ef2b4cf9ae1590e7: Status 404 returned error can't find the container with id e3a1c7f159fb1c9d6d61497f2d0d738d75ec953ec438e0d2ef2b4cf9ae1590e7 Jul 07 06:58:50.365315 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.365268 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2dcaa19_b75d_4f2f_91e5_ecf8ffac4f55.slice/crio-02eaa92f3c76bc5676b68205b09ba20decd8ebc97acee8024dfcb36bbc52fae3 WatchSource:0}: Error finding container 02eaa92f3c76bc5676b68205b09ba20decd8ebc97acee8024dfcb36bbc52fae3: Status 404 returned error can't find the container with id 02eaa92f3c76bc5676b68205b09ba20decd8ebc97acee8024dfcb36bbc52fae3 Jul 07 06:58:50.366075 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.366049 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9baf339b_df9a_4068_b99b_5b72a65307c1.slice/crio-06f1d321a8bd1a2da90bd4a3a1fbf6de03f8e7391c434ce2e8fd3d993b492a7b WatchSource:0}: Error finding container 06f1d321a8bd1a2da90bd4a3a1fbf6de03f8e7391c434ce2e8fd3d993b492a7b: Status 404 returned error can't find the container with id 06f1d321a8bd1a2da90bd4a3a1fbf6de03f8e7391c434ce2e8fd3d993b492a7b Jul 07 06:58:50.367052 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.367021 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode429cfcb_16dc_4927_be1a_b2856c65d4dd.slice/crio-8ffd301cf9a821e380c0523d9811d62a7c76fdcc0e825a0db1f5c1aa83b9c411 WatchSource:0}: Error finding container 8ffd301cf9a821e380c0523d9811d62a7c76fdcc0e825a0db1f5c1aa83b9c411: Status 404 returned error can't find the container with id 8ffd301cf9a821e380c0523d9811d62a7c76fdcc0e825a0db1f5c1aa83b9c411 Jul 07 06:58:50.369176 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:58:50.368524 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9072c5b_67b1_41cc_80c9_503b7096c72d.slice/crio-93e77c1f5863206fc6435066a6e3fecd30a2b49253d7478874f642de6a637a72 WatchSource:0}: Error finding container 93e77c1f5863206fc6435066a6e3fecd30a2b49253d7478874f642de6a637a72: Status 404 returned error can't find the container with id 93e77c1f5863206fc6435066a6e3fecd30a2b49253d7478874f642de6a637a72 Jul 07 06:58:50.648452 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:50.648246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:50.648554 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:50.648433 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:58:50.648554 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:50.648501 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:58:50.648554 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:50.648514 2565 projected.go:196] Error preparing data for projected volume kube-api-access-sjq4g for pod openshift-network-diagnostics/network-check-target-pgrb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:50.648727 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:50.648560 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g podName:0ecade35-d968-4d62-99fc-ebcf0a17cff8 nodeName:}" failed. No retries permitted until 2026-07-07 06:58:52.648545128 +0000 UTC m=+6.073758377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjq4g" (UniqueName: "kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g") pod "network-check-target-pgrb2" (UID: "0ecade35-d968-4d62-99fc-ebcf0a17cff8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:50.749903 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:50.749863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:50.750073 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:50.749913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:50.750073 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:50.750005 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:50.750073 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:50.750005 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:50.750073 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:50.750054 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret podName:8619f98f-805f-4ce7-83e8-8b1de3672e14 nodeName:}" failed. No retries permitted until 2026-07-07 06:58:52.750041235 +0000 UTC m=+6.175254483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret") pod "global-pull-secret-syncer-bfh2d" (UID: "8619f98f-805f-4ce7-83e8-8b1de3672e14") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:50.750073 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:50.750069 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs podName:e3e6926b-be32-403e-a606-04a5a6d3369b nodeName:}" failed. No retries permitted until 2026-07-07 06:58:52.750061912 +0000 UTC m=+6.175275162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs") pod "network-metrics-daemon-6tjjb" (UID: "e3e6926b-be32-403e-a606-04a5a6d3369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:51.079098 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.078985 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 06:53:49 +0000 UTC" deadline="2028-02-24 14:42:32.76831533 +0000 UTC" Jul 07 06:58:51.079098 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.079044 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14335h43m41.689275575s" Jul 07 06:58:51.129563 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.128775 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:51.129563 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:51.128999 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:58:51.129563 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.129421 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:51.129563 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:51.129515 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:58:51.130223 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.130003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:51.130223 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:51.130113 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:58:51.145637 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.145530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mlzbz" event={"ID":"4c886299-6ad7-401a-8a58-fc1aea3cef70","Type":"ContainerStarted","Data":"6f8c7a349c7600163b53f5c98c8e2f81863a8cbfeb94940a0d42a300f3dcf6a9"} Jul 07 06:58:51.149510 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.149437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8hjwm" event={"ID":"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e","Type":"ContainerStarted","Data":"dc339b0753080b6d20e03eea2fa2ee56620c946ea0e1f91c0eb6c1abddf65b02"} Jul 07 06:58:51.154680 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.154616 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stzn4" event={"ID":"dbe3ed12-65a1-4a01-a51f-37ca984cd135","Type":"ContainerStarted","Data":"d561419fff94fca9741f6cd94da5ff01d1a0107a918a18e6d67eb0769092af79"} Jul 07 06:58:51.158191 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.158126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zf7db" event={"ID":"b9072c5b-67b1-41cc-80c9-503b7096c72d","Type":"ContainerStarted","Data":"93e77c1f5863206fc6435066a6e3fecd30a2b49253d7478874f642de6a637a72"} Jul 07 06:58:51.161008 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.160950 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" event={"ID":"9baf339b-df9a-4068-b99b-5b72a65307c1","Type":"ContainerStarted","Data":"06f1d321a8bd1a2da90bd4a3a1fbf6de03f8e7391c434ce2e8fd3d993b492a7b"} Jul 07 06:58:51.176117 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.176030 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" event={"ID":"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25","Type":"ContainerStarted","Data":"4e26f1d24fa83820103ecd9ced0b602dfa2b6acfd437d063cda7761ae2e1ee3d"} Jul 07 06:58:51.188618 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.188590 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" event={"ID":"d196a27e053baa6bcb43fbca1f374dc8","Type":"ContainerStarted","Data":"ea93f3a14370981b5774972f81ac26ea6bf34b8f7a08c35b50b90d6b62d3ce53"} Jul 07 06:58:51.198815 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.198785 2565 generic.go:356] "Generic (PLEG): container finished" podID="29eb388a53f1b996afbf5bcbd6cb4dea" containerID="e4ae92b718e4a0d9bd91e279cfc31080b23b71f5c3d7d5e74a90ca1f9e9d95a8" exitCode=0 Jul 07 06:58:51.199423 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.199399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" event={"ID":"29eb388a53f1b996afbf5bcbd6cb4dea","Type":"ContainerDied","Data":"e4ae92b718e4a0d9bd91e279cfc31080b23b71f5c3d7d5e74a90ca1f9e9d95a8"} Jul 07 06:58:51.223177 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.223123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znvk6" event={"ID":"e429cfcb-16dc-4927-be1a-b2856c65d4dd","Type":"ContainerStarted","Data":"8ffd301cf9a821e380c0523d9811d62a7c76fdcc0e825a0db1f5c1aa83b9c411"} Jul 07 06:58:51.229497 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.228543 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-175.ec2.internal" podStartSLOduration=2.228523148 podStartE2EDuration="2.228523148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:58:51.208499266 +0000 UTC m=+4.633712539" watchObservedRunningTime="2026-07-07 06:58:51.228523148 +0000 UTC m=+4.653736422" Jul 07 06:58:51.229695 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.229604 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twmtc" event={"ID":"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55","Type":"ContainerStarted","Data":"02eaa92f3c76bc5676b68205b09ba20decd8ebc97acee8024dfcb36bbc52fae3"} Jul 07 06:58:51.247616 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:51.247506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"e3a1c7f159fb1c9d6d61497f2d0d738d75ec953ec438e0d2ef2b4cf9ae1590e7"} Jul 07 06:58:52.268530 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:52.268371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" event={"ID":"29eb388a53f1b996afbf5bcbd6cb4dea","Type":"ContainerStarted","Data":"c55f92d33e0621d8bcb90fad6a5748e197ec4e4888b90e90279cc1ee3d836675"} Jul 07 06:58:52.667112 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:52.666556 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:52.667112 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:52.666803 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:58:52.667112 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:52.666826 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:58:52.667112 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:52.666851 2565 projected.go:196] Error preparing data for projected volume kube-api-access-sjq4g for pod openshift-network-diagnostics/network-check-target-pgrb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:52.667112 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:52.666913 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g podName:0ecade35-d968-4d62-99fc-ebcf0a17cff8 nodeName:}" failed. No retries permitted until 2026-07-07 06:58:56.666893569 +0000 UTC m=+10.092106820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjq4g" (UniqueName: "kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g") pod "network-check-target-pgrb2" (UID: "0ecade35-d968-4d62-99fc-ebcf0a17cff8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:52.767709 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:52.767661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:52.767709 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:52.767716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:52.768022 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:52.767891 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:52.768022 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:52.767958 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret podName:8619f98f-805f-4ce7-83e8-8b1de3672e14 nodeName:}" failed. No retries permitted until 2026-07-07 06:58:56.767939695 +0000 UTC m=+10.193152943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret") pod "global-pull-secret-syncer-bfh2d" (UID: "8619f98f-805f-4ce7-83e8-8b1de3672e14") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:52.768427 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:52.768394 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:52.768703 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:52.768459 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs podName:e3e6926b-be32-403e-a606-04a5a6d3369b nodeName:}" failed. No retries permitted until 2026-07-07 06:58:56.768444577 +0000 UTC m=+10.193657828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs") pod "network-metrics-daemon-6tjjb" (UID: "e3e6926b-be32-403e-a606-04a5a6d3369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:53.133911 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:53.133811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:53.134093 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:53.133828 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:53.134093 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:53.134001 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:58:53.134093 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:53.134034 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:53.134339 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:53.134183 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:58:53.134339 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:53.134302 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:58:55.129505 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:55.129471 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:55.129981 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:55.129620 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:58:55.130048 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:55.129997 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:55.130104 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:55.130087 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:58:55.130237 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:55.130214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:55.130371 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:55.130349 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:58:56.703166 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:56.703131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:56.703565 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:56.703268 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:58:56.703565 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:56.703297 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:58:56.703565 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:56.703310 2565 projected.go:196] Error preparing data for projected volume kube-api-access-sjq4g for pod openshift-network-diagnostics/network-check-target-pgrb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:56.703565 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:56.703373 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g podName:0ecade35-d968-4d62-99fc-ebcf0a17cff8 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:04.703353781 +0000 UTC m=+18.128567030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjq4g" (UniqueName: "kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g") pod "network-check-target-pgrb2" (UID: "0ecade35-d968-4d62-99fc-ebcf0a17cff8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:58:56.803533 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:56.803497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:56.803736 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:56.803545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:56.803736 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:56.803666 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:56.803736 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:56.803733 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret podName:8619f98f-805f-4ce7-83e8-8b1de3672e14 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:04.803714178 +0000 UTC m=+18.228927448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret") pod "global-pull-secret-syncer-bfh2d" (UID: "8619f98f-805f-4ce7-83e8-8b1de3672e14") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:58:56.803911 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:56.803664 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:56.803911 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:56.803811 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs podName:e3e6926b-be32-403e-a606-04a5a6d3369b nodeName:}" failed. No retries permitted until 2026-07-07 06:59:04.803792758 +0000 UTC m=+18.229006025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs") pod "network-metrics-daemon-6tjjb" (UID: "e3e6926b-be32-403e-a606-04a5a6d3369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:58:57.128904 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:57.128826 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:57.129056 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:57.128918 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:58:57.129489 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:57.129233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:57.129489 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:57.129329 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:58:57.129489 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:57.129382 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:57.129489 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:57.129456 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:58:59.127806 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:59.127759 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:58:59.127806 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:59.127805 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:58:59.128351 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:59.127902 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:58:59.128351 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:59.128324 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:58:59.128458 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:58:59.128393 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:58:59.128509 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:58:59.128489 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:01.128524 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:01.128498 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:01.128847 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:01.128497 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:01.128847 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:01.128639 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:01.128847 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:01.128510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:01.128847 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:01.128668 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:01.128847 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:01.128744 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:03.128429 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:03.128336 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:03.128902 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:03.128338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:03.128902 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:03.128460 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:03.128902 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:03.128487 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:03.128902 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:03.128572 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:03.128902 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:03.128682 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:04.765160 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:04.765121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:04.765644 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:04.765285 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:59:04.765644 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:04.765305 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:59:04.765644 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:04.765317 2565 projected.go:196] Error preparing data for projected volume kube-api-access-sjq4g for pod openshift-network-diagnostics/network-check-target-pgrb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:59:04.765644 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:04.765371 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g podName:0ecade35-d968-4d62-99fc-ebcf0a17cff8 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:20.765352944 +0000 UTC m=+34.190566191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjq4g" (UniqueName: "kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g") pod "network-check-target-pgrb2" (UID: "0ecade35-d968-4d62-99fc-ebcf0a17cff8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:59:04.865817 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:04.865784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:04.865817 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:04.865819 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:04.866005 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:04.865921 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:59:04.866005 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:04.865930 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:59:04.866005 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:04.865971 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret podName:8619f98f-805f-4ce7-83e8-8b1de3672e14 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:20.865958291 +0000 UTC m=+34.291171537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret") pod "global-pull-secret-syncer-bfh2d" (UID: "8619f98f-805f-4ce7-83e8-8b1de3672e14") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:59:04.866005 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:04.865984 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs podName:e3e6926b-be32-403e-a606-04a5a6d3369b nodeName:}" failed. No retries permitted until 2026-07-07 06:59:20.865977565 +0000 UTC m=+34.291190813 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs") pod "network-metrics-daemon-6tjjb" (UID: "e3e6926b-be32-403e-a606-04a5a6d3369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:59:05.128230 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:05.128143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:05.128394 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:05.128253 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:05.128394 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:05.128282 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:05.128394 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:05.128353 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:05.128394 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:05.128390 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:05.128626 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:05.128463 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:07.129022 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:07.128987 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:07.129476 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:07.129090 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:07.129476 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:07.129130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:07.129476 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:07.129135 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:07.129476 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:07.129215 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:07.129476 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:07.129292 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:09.127599 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:09.127554 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:09.127599 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:09.127572 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:09.128027 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:09.127554 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:09.128027 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:09.127680 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:09.128027 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:09.127738 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:09.128027 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:09.127804 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:10.308493 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.308195 2565 generic.go:356] "Generic (PLEG): container finished" podID="e429cfcb-16dc-4927-be1a-b2856c65d4dd" containerID="761c62e3d88858ef7397d0bd9d9098ff2d72685524615e0a689586771b3a6e3b" exitCode=0 Jul 07 06:59:10.309307 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.308287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znvk6" event={"ID":"e429cfcb-16dc-4927-be1a-b2856c65d4dd","Type":"ContainerDied","Data":"761c62e3d88858ef7397d0bd9d9098ff2d72685524615e0a689586771b3a6e3b"} Jul 07 06:59:10.311861 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.311837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"6e44e6346f21318916c5f4b5bdb0301c877f36ec83a4e8acf80ddce8ccf1fa37"} Jul 07 06:59:10.311943 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.311897 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"73b0d9a02df232e39cc2348cdfce4dc0c588ade27fca4f31ea414f6419622aa5"} Jul 07 06:59:10.311992 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.311947 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"9d5895bedeead55260c2931388418d60c9e71efae8b9afbe0c2408ecdc3d28a6"} Jul 07 06:59:10.312036 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.311994 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"5b0f3f4f1159e4d2d6ba34e5be61ca392b9944b1ef88d642bbd5929809dc4a6e"} Jul 07 06:59:10.312036 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.312026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"c97915636580b6f4673e077bf6188ee1c32a4dd62df28644c696d9adf8d948a8"} Jul 07 06:59:10.312136 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.312061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"4f4263e2b26635ffdf13ccf319dff6981c99d5028e2a3e9601340681c75e9714"} Jul 07 06:59:10.313285 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.313256 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mlzbz" event={"ID":"4c886299-6ad7-401a-8a58-fc1aea3cef70","Type":"ContainerStarted","Data":"cb5a6b356d26cbcfa1d51245e4938b64371c0c6033534317c37731cf89b49cc6"} Jul 07 06:59:10.314838 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.314814 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8hjwm" event={"ID":"89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e","Type":"ContainerStarted","Data":"d639b1776596af12262acb6eea07ab51ffd093a45f831d693b575e99fc8d4794"} Jul 07 06:59:10.316190 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.316168 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stzn4" event={"ID":"dbe3ed12-65a1-4a01-a51f-37ca984cd135","Type":"ContainerStarted","Data":"da7afc1f963321bd867c0955a943e4d76200672e2563d8d3a2f139a95f226e4e"} Jul 07 06:59:10.319321 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.319287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zf7db" event={"ID":"b9072c5b-67b1-41cc-80c9-503b7096c72d","Type":"ContainerStarted","Data":"0de2bfb0392dadc7c3923fc6825af922eb7d5bddcaf118b6841b3a5cdba1d853"} Jul 07 06:59:10.320647 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.320627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" event={"ID":"9baf339b-df9a-4068-b99b-5b72a65307c1","Type":"ContainerStarted","Data":"a42de65172aa6655618c44ff34758c44455d9e5b12a5884952d8dd5648421615"} Jul 07 06:59:10.321972 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.321955 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" event={"ID":"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25","Type":"ContainerStarted","Data":"f67b559de09ed2e0b6e550747364a127663d7190f51f7001153c140d7fb54829"} Jul 07 06:59:10.335034 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.334992 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-175.ec2.internal" podStartSLOduration=21.334977672 podStartE2EDuration="21.334977672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:58:52.289371723 +0000 UTC m=+5.714585000" watchObservedRunningTime="2026-07-07 06:59:10.334977672 +0000 UTC m=+23.760190941" Jul 07 06:59:10.352922 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.352881 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8hjwm" podStartSLOduration=4.505539941 podStartE2EDuration="23.352866089s" totalImagesPullingTime="18.847326148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:10.352866243 +0000 UTC m=+23.778079506" watchObservedRunningTime="2026-07-07 06:59:10.352866089 +0000 UTC m=+23.778079359" Jul 07 06:59:10.370290 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.370251 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-stzn4" podStartSLOduration=12.620341706 podStartE2EDuration="23.370237175s" totalImagesPullingTime="10.749895469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:10.369905554 +0000 UTC m=+23.795118816" watchObservedRunningTime="2026-07-07 06:59:10.370237175 +0000 UTC m=+23.795450462" Jul 07 06:59:10.385866 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.385811 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zf7db" podStartSLOduration=4.576068129 podStartE2EDuration="23.385796538s" totalImagesPullingTime="18.809728409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:10.385142548 +0000 UTC m=+23.810355809" watchObservedRunningTime="2026-07-07 06:59:10.385796538 +0000 UTC m=+23.811009807" Jul 07 06:59:10.407726 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.407679 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mlzbz" podStartSLOduration=4.535969283 podStartE2EDuration="23.407661322s" totalImagesPullingTime="18.871692039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:10.407233123 +0000 UTC m=+23.832446393" watchObservedRunningTime="2026-07-07 06:59:10.407661322 +0000 UTC m=+23.832874592" Jul 07 06:59:10.428936 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.428886 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bxwpx" podStartSLOduration=4.59660866 podStartE2EDuration="23.428869356s" totalImagesPullingTime="18.832260696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:10.428483202 +0000 UTC m=+23.853696470" watchObservedRunningTime="2026-07-07 06:59:10.428869356 +0000 UTC m=+23.854082625" Jul 07 06:59:10.618403 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:10.618367 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 06:59:11.020356 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.020318 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:59:11.020977 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.020953 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:59:11.082962 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.082842 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T06:59:10.618397777Z","UUID":"a269a285-b038-4e0c-9151-0905ad631d52","Handler":null,"Name":"","Endpoint":""} Jul 07 06:59:11.084406 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.084375 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 06:59:11.084406 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.084407 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 06:59:11.127767 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.127732 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:11.127767 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.127757 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:11.127767 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.127770 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:11.128093 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:11.127861 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:11.128093 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:11.127972 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:11.128093 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:11.128064 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:11.326071 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.325985 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twmtc" event={"ID":"d2dcaa19-b75d-4f2f-91e5-ecf8ffac4f55","Type":"ContainerStarted","Data":"3bbe8a1b562210b6c1d55ce5189d1dc3849573342dd645ac9890e431cca7bbb9"} Jul 07 06:59:11.327880 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.327853 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" event={"ID":"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25","Type":"ContainerStarted","Data":"c2187bf5dbd65142cbcd1a20a1b662b300b17aef3c9c32879c82644db9e34143"} Jul 07 06:59:11.328544 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.328500 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:59:11.329006 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.328988 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-stzn4" Jul 07 06:59:11.344216 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:11.344169 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-twmtc" podStartSLOduration=5.534519342 podStartE2EDuration="24.344153037s" totalImagesPullingTime="18.809633695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:11.343802615 +0000 UTC m=+24.769015885" watchObservedRunningTime="2026-07-07 06:59:11.344153037 +0000 UTC m=+24.769366305" Jul 07 06:59:12.336171 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:12.335938 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"df3f855d3c67176211ef9dcf24879b7726f2dab5b8df1aa4539a30ac8ced436b"} Jul 07 06:59:12.338095 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:12.338060 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" event={"ID":"1a1cdd9c-bf80-4ca3-b46a-24f108f63b25","Type":"ContainerStarted","Data":"f42b1e4b28217666ed3de6ac0bd733d7d4c1b89d383bd9d72003a2a472feb7a4"} Jul 07 06:59:12.359032 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:12.358982 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwcrw" podStartSLOduration=4.413583721 podStartE2EDuration="25.358968096s" totalImagesPullingTime="20.945384375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:12.358827851 +0000 UTC m=+25.784041121" watchObservedRunningTime="2026-07-07 06:59:12.358968096 +0000 UTC m=+25.784181365" Jul 07 06:59:13.127827 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:13.127799 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:13.128042 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:13.127801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:13.128042 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:13.127933 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:13.128042 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:13.127801 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:13.128042 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:13.128003 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:13.128233 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:13.128118 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:15.128497 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.128325 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:15.129069 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.128339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:15.129069 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:15.128577 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:15.129069 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.128347 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:15.129069 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:15.128702 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:15.129069 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:15.128748 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:15.346525 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.346441 2565 generic.go:356] "Generic (PLEG): container finished" podID="e429cfcb-16dc-4927-be1a-b2856c65d4dd" containerID="a8632dc49a3d96552ea04182f983e0d0e3689f1095cf8745d0cf8993563bdb8f" exitCode=0 Jul 07 06:59:15.346525 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.346516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znvk6" event={"ID":"e429cfcb-16dc-4927-be1a-b2856c65d4dd","Type":"ContainerDied","Data":"a8632dc49a3d96552ea04182f983e0d0e3689f1095cf8745d0cf8993563bdb8f"} Jul 07 06:59:15.350059 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.350035 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" event={"ID":"5d599faa-3163-4d8d-983b-cb993cc0a8af","Type":"ContainerStarted","Data":"0ad3c65bb15884699f1ab18f7df0c4ab3984b3334908ff0892d12194071f5610"} Jul 07 06:59:15.350328 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.350307 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:59:15.350435 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.350373 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:59:15.365425 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.365405 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:59:15.403664 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:15.403619 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" podStartSLOduration=9.516255661 podStartE2EDuration="28.403606214s" totalImagesPullingTime="18.887350553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:15.402557448 +0000 UTC m=+28.827770717" watchObservedRunningTime="2026-07-07 06:59:15.403606214 +0000 UTC m=+28.828819480" Jul 07 06:59:16.352507 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.352480 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:59:16.367985 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.367958 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:59:16.537066 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.537039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:16.628974 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.628945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:16.943477 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.943275 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfh2d"] Jul 07 06:59:16.943628 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.943510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:16.943628 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:16.943610 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:16.945722 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.945673 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgrb2"] Jul 07 06:59:16.945844 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.945780 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:16.945887 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:16.945870 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:16.946227 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.946210 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tjjb"] Jul 07 06:59:16.946305 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:16.946294 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:16.946416 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:16.946397 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:17.356001 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:17.355910 2565 generic.go:356] "Generic (PLEG): container finished" podID="e429cfcb-16dc-4927-be1a-b2856c65d4dd" containerID="544af2ca132ecacac58057c2fe794724a19115e95b5e8c164944dc68d5ca9a72" exitCode=0 Jul 07 06:59:17.356439 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:17.355994 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znvk6" event={"ID":"e429cfcb-16dc-4927-be1a-b2856c65d4dd","Type":"ContainerDied","Data":"544af2ca132ecacac58057c2fe794724a19115e95b5e8c164944dc68d5ca9a72"} Jul 07 06:59:18.128576 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:18.128542 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:18.128763 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:18.128709 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:19.127633 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:19.127580 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:19.128245 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:19.127694 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:19.128245 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:19.127750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:19.128245 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:19.127851 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:19.362648 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:19.362544 2565 generic.go:356] "Generic (PLEG): container finished" podID="e429cfcb-16dc-4927-be1a-b2856c65d4dd" containerID="7d44a2cba39c661c9dd2b05db21dcd1fa236d80bf57f49bfa6cad6fed2e65997" exitCode=0 Jul 07 06:59:19.362648 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:19.362614 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znvk6" event={"ID":"e429cfcb-16dc-4927-be1a-b2856c65d4dd","Type":"ContainerDied","Data":"7d44a2cba39c661c9dd2b05db21dcd1fa236d80bf57f49bfa6cad6fed2e65997"} Jul 07 06:59:20.128388 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:20.128356 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:20.128953 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.128503 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tjjb" podUID="e3e6926b-be32-403e-a606-04a5a6d3369b" Jul 07 06:59:20.783348 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:20.783311 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:20.783541 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.783481 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 06:59:20.783541 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.783512 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 06:59:20.783541 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.783522 2565 projected.go:196] Error preparing data for projected volume kube-api-access-sjq4g for pod openshift-network-diagnostics/network-check-target-pgrb2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:59:20.783737 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.783599 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g podName:0ecade35-d968-4d62-99fc-ebcf0a17cff8 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:52.783564311 +0000 UTC m=+66.208777578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sjq4g" (UniqueName: "kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g") pod "network-check-target-pgrb2" (UID: "0ecade35-d968-4d62-99fc-ebcf0a17cff8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 06:59:20.884627 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:20.884572 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:20.884812 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:20.884639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:20.884812 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.884742 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 06:59:20.884812 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.884746 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:59:20.884812 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.884803 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret podName:8619f98f-805f-4ce7-83e8-8b1de3672e14 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:52.884785875 +0000 UTC m=+66.309999137 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret") pod "global-pull-secret-syncer-bfh2d" (UID: "8619f98f-805f-4ce7-83e8-8b1de3672e14") : object "kube-system"/"original-pull-secret" not registered Jul 07 06:59:20.884812 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:20.884818 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs podName:e3e6926b-be32-403e-a606-04a5a6d3369b nodeName:}" failed. No retries permitted until 2026-07-07 06:59:52.884811068 +0000 UTC m=+66.310024315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs") pod "network-metrics-daemon-6tjjb" (UID: "e3e6926b-be32-403e-a606-04a5a6d3369b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 06:59:21.127871 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.127800 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:21.128022 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.127800 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:21.128022 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:21.127930 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfh2d" podUID="8619f98f-805f-4ce7-83e8-8b1de3672e14" Jul 07 06:59:21.128117 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:21.128026 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pgrb2" podUID="0ecade35-d968-4d62-99fc-ebcf0a17cff8" Jul 07 06:59:21.405887 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.405798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:21.466596 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.466555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:21.815424 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.815398 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-175.ec2.internal" event="NodeReady" Jul 07 06:59:21.815574 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.815554 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 06:59:21.867069 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.867029 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-29ghm"] Jul 07 06:59:21.870858 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.870834 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-drl6g"] Jul 07 06:59:21.870998 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.870980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-29ghm" Jul 07 06:59:21.872947 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.872921 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 06:59:21.873267 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.873250 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7mlnr\"" Jul 07 06:59:21.873367 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.873256 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 06:59:21.873431 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.873388 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 06:59:21.875175 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.875153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:21.877181 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.877161 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 06:59:21.877284 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.877200 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vfjqn\"" Jul 07 06:59:21.877284 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.877200 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 06:59:21.881643 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.881611 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-29ghm"] Jul 07 06:59:21.898150 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.898123 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-drl6g"] Jul 07 06:59:21.993167 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.993084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e484a269-46ab-4d05-9c32-6ab0c7e58d7e-cert\") pod \"ingress-canary-29ghm\" (UID: \"e484a269-46ab-4d05-9c32-6ab0c7e58d7e\") " pod="openshift-ingress-canary/ingress-canary-29ghm" Jul 07 06:59:21.993167 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.993130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lnkj\" (UniqueName: \"kubernetes.io/projected/e484a269-46ab-4d05-9c32-6ab0c7e58d7e-kube-api-access-6lnkj\") pod \"ingress-canary-29ghm\" (UID: \"e484a269-46ab-4d05-9c32-6ab0c7e58d7e\") " pod="openshift-ingress-canary/ingress-canary-29ghm" Jul 07 06:59:21.993394 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.993204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff0cbbb7-f327-4c1e-a923-501328a5803e-config-volume\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:21.993394 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.993228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:21.993394 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.993253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0cbbb7-f327-4c1e-a923-501328a5803e-tmp-dir\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:21.993394 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:21.993285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82qb7\" (UniqueName: \"kubernetes.io/projected/ff0cbbb7-f327-4c1e-a923-501328a5803e-kube-api-access-82qb7\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.017424 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.017395 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:22.094171 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.093981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff0cbbb7-f327-4c1e-a923-501328a5803e-config-volume\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.094332 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.094187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.094332 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.094214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0cbbb7-f327-4c1e-a923-501328a5803e-tmp-dir\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.094332 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.094257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82qb7\" (UniqueName: \"kubernetes.io/projected/ff0cbbb7-f327-4c1e-a923-501328a5803e-kube-api-access-82qb7\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.094505 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.094339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e484a269-46ab-4d05-9c32-6ab0c7e58d7e-cert\") pod \"ingress-canary-29ghm\" (UID: \"e484a269-46ab-4d05-9c32-6ab0c7e58d7e\") " pod="openshift-ingress-canary/ingress-canary-29ghm" Jul 07 06:59:22.094505 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.094395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lnkj\" (UniqueName: \"kubernetes.io/projected/e484a269-46ab-4d05-9c32-6ab0c7e58d7e-kube-api-access-6lnkj\") pod \"ingress-canary-29ghm\" (UID: \"e484a269-46ab-4d05-9c32-6ab0c7e58d7e\") " pod="openshift-ingress-canary/ingress-canary-29ghm" Jul 07 06:59:22.094656 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.094631 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff0cbbb7-f327-4c1e-a923-501328a5803e-config-volume\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.094786 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:22.094641 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:59:22.094786 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.094673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff0cbbb7-f327-4c1e-a923-501328a5803e-tmp-dir\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.094786 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:22.094727 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls podName:ff0cbbb7-f327-4c1e-a923-501328a5803e nodeName:}" failed. No retries permitted until 2026-07-07 06:59:22.594705643 +0000 UTC m=+36.019918890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls") pod "dns-default-drl6g" (UID: "ff0cbbb7-f327-4c1e-a923-501328a5803e") : secret "dns-default-metrics-tls" not found Jul 07 06:59:22.099307 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.099286 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e484a269-46ab-4d05-9c32-6ab0c7e58d7e-cert\") pod \"ingress-canary-29ghm\" (UID: \"e484a269-46ab-4d05-9c32-6ab0c7e58d7e\") " pod="openshift-ingress-canary/ingress-canary-29ghm" Jul 07 06:59:22.103500 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.103478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82qb7\" (UniqueName: \"kubernetes.io/projected/ff0cbbb7-f327-4c1e-a923-501328a5803e-kube-api-access-82qb7\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.103652 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.103518 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lnkj\" (UniqueName: \"kubernetes.io/projected/e484a269-46ab-4d05-9c32-6ab0c7e58d7e-kube-api-access-6lnkj\") pod \"ingress-canary-29ghm\" (UID: \"e484a269-46ab-4d05-9c32-6ab0c7e58d7e\") " pod="openshift-ingress-canary/ingress-canary-29ghm" Jul 07 06:59:22.113213 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.113176 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:22.128213 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.128188 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:22.130963 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.130942 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 06:59:22.131131 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.131112 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-59nzl\"" Jul 07 06:59:22.183677 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.183641 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-29ghm" Jul 07 06:59:22.599747 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:22.599704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:22.600190 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:22.599901 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:59:22.600190 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:22.599981 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls podName:ff0cbbb7-f327-4c1e-a923-501328a5803e nodeName:}" failed. No retries permitted until 2026-07-07 06:59:23.599957152 +0000 UTC m=+37.025170414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls") pod "dns-default-drl6g" (UID: "ff0cbbb7-f327-4c1e-a923-501328a5803e") : secret "dns-default-metrics-tls" not found Jul 07 06:59:23.127775 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:23.127731 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:23.127967 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:23.127934 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:23.130684 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:23.130661 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 06:59:23.131462 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:23.131397 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 06:59:23.131462 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:23.131401 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2lkzt\"" Jul 07 06:59:23.131639 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:23.131482 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 06:59:23.608060 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:23.608036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:23.608404 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:23.608224 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:59:23.608404 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:23.608304 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls podName:ff0cbbb7-f327-4c1e-a923-501328a5803e nodeName:}" failed. No retries permitted until 2026-07-07 06:59:25.608281174 +0000 UTC m=+39.033494433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls") pod "dns-default-drl6g" (UID: "ff0cbbb7-f327-4c1e-a923-501328a5803e") : secret "dns-default-metrics-tls" not found Jul 07 06:59:23.658237 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:23.658206 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-29ghm"] Jul 07 06:59:23.663031 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:59:23.663007 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode484a269_46ab_4d05_9c32_6ab0c7e58d7e.slice/crio-8b911e3e8cbddd7b6275903246f9f6cce44323a31d9c01cbae5dc19a6956cb75 WatchSource:0}: Error finding container 8b911e3e8cbddd7b6275903246f9f6cce44323a31d9c01cbae5dc19a6956cb75: Status 404 returned error can't find the container with id 8b911e3e8cbddd7b6275903246f9f6cce44323a31d9c01cbae5dc19a6956cb75 Jul 07 06:59:24.375770 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:24.375547 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-29ghm" event={"ID":"e484a269-46ab-4d05-9c32-6ab0c7e58d7e","Type":"ContainerStarted","Data":"8b911e3e8cbddd7b6275903246f9f6cce44323a31d9c01cbae5dc19a6956cb75"} Jul 07 06:59:24.381241 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:24.381207 2565 generic.go:356] "Generic (PLEG): container finished" podID="e429cfcb-16dc-4927-be1a-b2856c65d4dd" containerID="0f57bf5eeaa173671780328ee3aa198cea8ed48b62c22f7f05bb241d647b69ae" exitCode=0 Jul 07 06:59:24.381392 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:24.381270 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znvk6" event={"ID":"e429cfcb-16dc-4927-be1a-b2856c65d4dd","Type":"ContainerDied","Data":"0f57bf5eeaa173671780328ee3aa198cea8ed48b62c22f7f05bb241d647b69ae"} Jul 07 06:59:25.387491 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:25.387458 2565 generic.go:356] "Generic (PLEG): container finished" podID="e429cfcb-16dc-4927-be1a-b2856c65d4dd" containerID="2e1c43c7b9797a373e09234ff9aff7cb1ff3525ae2e9c127a3db7c12ce77a632" exitCode=0 Jul 07 06:59:25.387983 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:25.387496 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znvk6" event={"ID":"e429cfcb-16dc-4927-be1a-b2856c65d4dd","Type":"ContainerDied","Data":"2e1c43c7b9797a373e09234ff9aff7cb1ff3525ae2e9c127a3db7c12ce77a632"} Jul 07 06:59:25.625693 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:25.625660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:25.625860 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:25.625770 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:59:25.625860 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:25.625826 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls podName:ff0cbbb7-f327-4c1e-a923-501328a5803e nodeName:}" failed. No retries permitted until 2026-07-07 06:59:29.625808439 +0000 UTC m=+43.051021686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls") pod "dns-default-drl6g" (UID: "ff0cbbb7-f327-4c1e-a923-501328a5803e") : secret "dns-default-metrics-tls" not found Jul 07 06:59:26.391750 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:26.391709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-29ghm" event={"ID":"e484a269-46ab-4d05-9c32-6ab0c7e58d7e","Type":"ContainerStarted","Data":"59d263be2c6ea733de321525bd784d091ccdba67a056e5ddce4b9ad28fc77636"} Jul 07 06:59:26.396185 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:26.395720 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znvk6" event={"ID":"e429cfcb-16dc-4927-be1a-b2856c65d4dd","Type":"ContainerStarted","Data":"489768ffe0b0a2833a81481bb007b0969bf03f29cf78f2e8af2489bb2b079227"} Jul 07 06:59:26.404056 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:26.404030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:26.411247 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:26.411208 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-29ghm" podStartSLOduration=2.796744425 podStartE2EDuration="5.411195453s" totalImagesPullingTime="2.614451028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:26.409999823 +0000 UTC m=+39.835213096" watchObservedRunningTime="2026-07-07 06:59:26.411195453 +0000 UTC m=+39.836408770" Jul 07 06:59:26.435175 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:26.435131 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-znvk6" podStartSLOduration=9.664364322 podStartE2EDuration="39.435114358s" totalImagesPullingTime="29.770750036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:26.434543121 +0000 UTC m=+39.859756413" watchObservedRunningTime="2026-07-07 06:59:26.435114358 +0000 UTC m=+39.860327621" Jul 07 06:59:26.618302 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:26.618254 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:26.718650 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:26.718616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:27.617342 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:27.617311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:27.711658 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:27.711609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" limit=1024 Jul 07 06:59:29.653368 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:29.653328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:29.653874 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:29.653454 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:59:29.653874 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:29.653527 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls podName:ff0cbbb7-f327-4c1e-a923-501328a5803e nodeName:}" failed. No retries permitted until 2026-07-07 06:59:37.65350707 +0000 UTC m=+51.078720318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls") pod "dns-default-drl6g" (UID: "ff0cbbb7-f327-4c1e-a923-501328a5803e") : secret "dns-default-metrics-tls" not found Jul 07 06:59:37.707652 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:37.707609 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:37.708129 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:37.707769 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:59:37.708129 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:37.707854 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls podName:ff0cbbb7-f327-4c1e-a923-501328a5803e nodeName:}" failed. No retries permitted until 2026-07-07 06:59:53.707833797 +0000 UTC m=+67.133047054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls") pod "dns-default-drl6g" (UID: "ff0cbbb7-f327-4c1e-a923-501328a5803e") : secret "dns-default-metrics-tls" not found Jul 07 06:59:40.387275 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.387242 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w"] Jul 07 06:59:40.411529 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.411497 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz"] Jul 07 06:59:40.411690 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.411637 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w" Jul 07 06:59:40.414262 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.414238 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gwqc5\"" Jul 07 06:59:40.414606 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.414575 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:59:40.414606 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.414602 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 06:59:40.427198 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.427172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stzts\" (UniqueName: \"kubernetes.io/projected/627aff8d-0eb6-4cf5-af28-4bae58ca209b-kube-api-access-stzts\") pod \"volume-data-source-validator-5d456fdbcd-sbs8w\" (UID: \"627aff8d-0eb6-4cf5-af28-4bae58ca209b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w" Jul 07 06:59:40.435561 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.435535 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-dcff594f7-w7xr6"] Jul 07 06:59:40.435727 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.435676 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:40.438192 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.438170 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 06:59:40.438324 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.438192 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 06:59:40.438430 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.438416 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 06:59:40.438701 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.438688 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k67rb\"" Jul 07 06:59:40.459531 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.459498 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c46489cd5-j68pq"] Jul 07 06:59:40.459727 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.459645 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.463655 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.463633 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 06:59:40.464005 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.463984 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 06:59:40.464185 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.464169 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 06:59:40.464262 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.464189 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 06:59:40.464943 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.464927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 06:59:40.465160 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.465146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9cq26\"" Jul 07 06:59:40.465212 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.465175 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 06:59:40.475816 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.475788 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w"] Jul 07 06:59:40.475816 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.475821 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz"] Jul 07 06:59:40.476000 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.475840 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c46489cd5-j68pq"] Jul 07 06:59:40.476000 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.475919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.476000 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.475934 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dcff594f7-w7xr6"] Jul 07 06:59:40.478362 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.478340 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 06:59:40.478482 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.478446 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 06:59:40.478545 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.478520 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7j9bg\"" Jul 07 06:59:40.478792 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.478778 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 06:59:40.500599 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.500547 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 06:59:40.527777 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.527741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stzts\" (UniqueName: \"kubernetes.io/projected/627aff8d-0eb6-4cf5-af28-4bae58ca209b-kube-api-access-stzts\") pod \"volume-data-source-validator-5d456fdbcd-sbs8w\" (UID: \"627aff8d-0eb6-4cf5-af28-4bae58ca209b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w" Jul 07 06:59:40.527965 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.527778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.527965 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.527914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.527965 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.527944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkzq9\" (UniqueName: \"kubernetes.io/projected/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-kube-api-access-tkzq9\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.528075 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.527963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-installation-pull-secrets\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.528075 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.528136 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-ca-trust-extracted\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.528136 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-bound-sa-token\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.528198 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-trusted-ca\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.528198 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fljpw\" (UniqueName: \"kubernetes.io/projected/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-kube-api-access-fljpw\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:40.528258 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-stats-auth\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.528258 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528242 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-default-certificate\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.528321 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h78k7\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-kube-api-access-h78k7\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.528321 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-image-registry-private-configuration\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.528321 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:40.528409 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.528358 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-certificates\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.541833 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.541799 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stzts\" (UniqueName: \"kubernetes.io/projected/627aff8d-0eb6-4cf5-af28-4bae58ca209b-kube-api-access-stzts\") pod \"volume-data-source-validator-5d456fdbcd-sbs8w\" (UID: \"627aff8d-0eb6-4cf5-af28-4bae58ca209b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w" Jul 07 06:59:40.628979 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.628942 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-ca-trust-extracted\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.628979 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.628980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-bound-sa-token\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.629228 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-trusted-ca\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.629228 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fljpw\" (UniqueName: \"kubernetes.io/projected/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-kube-api-access-fljpw\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:40.629228 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-stats-auth\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.629352 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-default-certificate\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.629352 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h78k7\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-kube-api-access-h78k7\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.629352 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629342 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-image-registry-private-configuration\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.629486 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:40.629486 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629379 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-ca-trust-extracted\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.629486 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629414 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-certificates\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.629486 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.629486 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:40.629479 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:59:40.629747 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.629747 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:40.629543 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls podName:d7a6b442-6b4c-4bb0-878b-18a77f8894d7 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:41.129526192 +0000 UTC m=+54.554739453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mpnsz" (UID: "d7a6b442-6b4c-4bb0-878b-18a77f8894d7") : secret "samples-operator-tls" not found Jul 07 06:59:40.629747 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkzq9\" (UniqueName: \"kubernetes.io/projected/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-kube-api-access-tkzq9\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.629747 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:40.629611 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:59:40.629747 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-installation-pull-secrets\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.629747 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.629645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.629747 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:40.629671 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:41.129656972 +0000 UTC m=+54.554870226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : secret "router-metrics-certs-default" not found Jul 07 06:59:40.629747 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:40.629722 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:41.129712332 +0000 UTC m=+54.554925599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : configmap references non-existent config key: service-ca.crt Jul 07 06:59:40.630114 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:40.629878 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:59:40.630114 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:40.629895 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c46489cd5-j68pq: secret "image-registry-tls" not found Jul 07 06:59:40.630114 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:40.629941 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls podName:cd30f27a-ce33-458b-8b0c-90c12d3a2c96 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:41.129925153 +0000 UTC m=+54.555138405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls") pod "image-registry-c46489cd5-j68pq" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96") : secret "image-registry-tls" not found Jul 07 06:59:40.630268 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.630156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-trusted-ca\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.630268 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.630250 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-certificates\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.631839 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.631816 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-default-certificate\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.632035 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.632013 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-image-registry-private-configuration\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.632104 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.632025 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-installation-pull-secrets\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.632104 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.632054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-stats-auth\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.643121 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.643059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fljpw\" (UniqueName: \"kubernetes.io/projected/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-kube-api-access-fljpw\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:40.648717 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.648695 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-bound-sa-token\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.648846 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.648830 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkzq9\" (UniqueName: \"kubernetes.io/projected/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-kube-api-access-tkzq9\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:40.651240 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.651222 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h78k7\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-kube-api-access-h78k7\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:40.722249 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.722207 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w" Jul 07 06:59:40.875435 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:40.875399 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w"] Jul 07 06:59:40.878646 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:59:40.878620 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627aff8d_0eb6_4cf5_af28_4bae58ca209b.slice/crio-11e01646f16633f9c68d7cfb0c340d815aca1127b1471b970fdedc9897e7ddc0 WatchSource:0}: Error finding container 11e01646f16633f9c68d7cfb0c340d815aca1127b1471b970fdedc9897e7ddc0: Status 404 returned error can't find the container with id 11e01646f16633f9c68d7cfb0c340d815aca1127b1471b970fdedc9897e7ddc0 Jul 07 06:59:41.133163 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:41.133137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:41.133350 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:41.133186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:41.133350 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:41.133219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:41.133350 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:41.133265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:41.133350 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:41.133290 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:59:41.133350 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:41.133340 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls podName:d7a6b442-6b4c-4bb0-878b-18a77f8894d7 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:42.133326097 +0000 UTC m=+55.558539343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mpnsz" (UID: "d7a6b442-6b4c-4bb0-878b-18a77f8894d7") : secret "samples-operator-tls" not found Jul 07 06:59:41.133610 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:41.133425 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:42.133411242 +0000 UTC m=+55.558624493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : configmap references non-existent config key: service-ca.crt Jul 07 06:59:41.133610 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:41.133446 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:59:41.133610 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:41.133465 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c46489cd5-j68pq: secret "image-registry-tls" not found Jul 07 06:59:41.133610 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:41.133489 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:59:41.133610 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:41.133517 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls podName:cd30f27a-ce33-458b-8b0c-90c12d3a2c96 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:42.133500651 +0000 UTC m=+55.558713915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls") pod "image-registry-c46489cd5-j68pq" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96") : secret "image-registry-tls" not found Jul 07 06:59:41.133610 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:41.133533 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:42.133522823 +0000 UTC m=+55.558736073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : secret "router-metrics-certs-default" not found Jul 07 06:59:41.434567 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:41.434483 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w" event={"ID":"627aff8d-0eb6-4cf5-af28-4bae58ca209b","Type":"ContainerStarted","Data":"11e01646f16633f9c68d7cfb0c340d815aca1127b1471b970fdedc9897e7ddc0"} Jul 07 06:59:42.141647 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:42.141607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:42.141647 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:42.141654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:42.141851 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:42.141678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:42.141851 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:42.141756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:42.141851 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:42.141770 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:59:42.141851 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:42.141793 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c46489cd5-j68pq: secret "image-registry-tls" not found Jul 07 06:59:42.141851 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:42.141772 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:59:42.141851 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:42.141840 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:59:42.142043 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:42.141844 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls podName:cd30f27a-ce33-458b-8b0c-90c12d3a2c96 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:44.141826696 +0000 UTC m=+57.567039949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls") pod "image-registry-c46489cd5-j68pq" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96") : secret "image-registry-tls" not found Jul 07 06:59:42.142043 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:42.141891 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:44.141880554 +0000 UTC m=+57.567093801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : configmap references non-existent config key: service-ca.crt Jul 07 06:59:42.142043 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:42.141902 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:44.141895826 +0000 UTC m=+57.567109073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : secret "router-metrics-certs-default" not found Jul 07 06:59:42.142043 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:42.141912 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls podName:d7a6b442-6b4c-4bb0-878b-18a77f8894d7 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:44.141907168 +0000 UTC m=+57.567120415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mpnsz" (UID: "d7a6b442-6b4c-4bb0-878b-18a77f8894d7") : secret "samples-operator-tls" not found Jul 07 06:59:42.438196 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:42.438108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w" event={"ID":"627aff8d-0eb6-4cf5-af28-4bae58ca209b","Type":"ContainerStarted","Data":"b998baccb4072d817ff1d2c7168e1c81ab9b8e1285474cebc1b2d44a122ec1a1"} Jul 07 06:59:44.157880 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:44.157833 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:44.157880 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:44.157887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:44.157920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:44.157965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:44.157991 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:44.158010 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c46489cd5-j68pq: secret "image-registry-tls" not found Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:44.158042 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:44.158059 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls podName:cd30f27a-ce33-458b-8b0c-90c12d3a2c96 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:48.158045186 +0000 UTC m=+61.583258433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls") pod "image-registry-c46489cd5-j68pq" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96") : secret "image-registry-tls" not found Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:44.158075 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls podName:d7a6b442-6b4c-4bb0-878b-18a77f8894d7 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:48.158064173 +0000 UTC m=+61.583277420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mpnsz" (UID: "d7a6b442-6b4c-4bb0-878b-18a77f8894d7") : secret "samples-operator-tls" not found Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:44.158085 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:44.158095 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:48.158081297 +0000 UTC m=+61.583294544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : configmap references non-existent config key: service-ca.crt Jul 07 06:59:44.158425 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:44.158121 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:48.158110671 +0000 UTC m=+61.583323918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : secret "router-metrics-certs-default" not found Jul 07 06:59:47.450962 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.450900 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-sbs8w" podStartSLOduration=6.128403847 podStartE2EDuration="7.450880661s" totalImagesPullingTime="1.322476814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:42.459218345 +0000 UTC m=+55.884431613" watchObservedRunningTime="2026-07-07 06:59:47.450880661 +0000 UTC m=+60.876093927" Jul 07 06:59:47.451921 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.451900 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dp2zz"] Jul 07 06:59:47.458204 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.458180 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.460928 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.460907 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s62sg\"" Jul 07 06:59:47.461021 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.460910 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 06:59:47.461536 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.461518 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 06:59:47.461536 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.461529 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 06:59:47.461711 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.461564 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 06:59:47.476337 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.476311 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dp2zz"] Jul 07 06:59:47.483839 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.483818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxv6k\" (UniqueName: \"kubernetes.io/projected/d5da8052-2965-416d-b290-d79c85a59e68-kube-api-access-cxv6k\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.483944 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.483873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5da8052-2965-416d-b290-d79c85a59e68-data-volume\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.483944 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.483926 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.484072 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.484014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.484115 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.484078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5da8052-2965-416d-b290-d79c85a59e68-crio-socket\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.584924 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.584878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5da8052-2965-416d-b290-d79c85a59e68-crio-socket\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.585111 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.584954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxv6k\" (UniqueName: \"kubernetes.io/projected/d5da8052-2965-416d-b290-d79c85a59e68-kube-api-access-cxv6k\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.585111 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.585006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5da8052-2965-416d-b290-d79c85a59e68-crio-socket\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.585111 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.585016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5da8052-2965-416d-b290-d79c85a59e68-data-volume\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.585111 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.585063 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.585340 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.585116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.585340 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:47.585207 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:59:47.585340 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:47.585232 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:59:47.585340 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:47.585293 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:48.08527906 +0000 UTC m=+61.510492310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : secret "insights-runtime-extractor-tls" not found Jul 07 06:59:47.585340 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:47.585310 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:48.085300852 +0000 UTC m=+61.510514099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : configmap "kube-rbac-proxy" not found Jul 07 06:59:47.585564 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.585340 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5da8052-2965-416d-b290-d79c85a59e68-data-volume\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:47.596004 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:47.595982 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxv6k\" (UniqueName: \"kubernetes.io/projected/d5da8052-2965-416d-b290-d79c85a59e68-kube-api-access-cxv6k\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:48.089955 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:48.089914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:48.090139 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:48.090018 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:48.090139 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.090041 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:59:48.090139 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.090101 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:49.09008551 +0000 UTC m=+62.515298757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : configmap "kube-rbac-proxy" not found Jul 07 06:59:48.090301 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.090156 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:59:48.090301 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.090224 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:49.090196489 +0000 UTC m=+62.515409736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : secret "insights-runtime-extractor-tls" not found Jul 07 06:59:48.191123 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:48.191073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:48.191311 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:48.191184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:48.191311 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.191241 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:56.191224641 +0000 UTC m=+69.616437887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : configmap references non-existent config key: service-ca.crt Jul 07 06:59:48.191311 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:48.191268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:48.191311 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:48.191298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:48.191311 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.191305 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 06:59:48.191512 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.191356 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls podName:d7a6b442-6b4c-4bb0-878b-18a77f8894d7 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:56.191340163 +0000 UTC m=+69.616553411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mpnsz" (UID: "d7a6b442-6b4c-4bb0-878b-18a77f8894d7") : secret "samples-operator-tls" not found Jul 07 06:59:48.191512 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.191386 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:59:48.191512 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.191400 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 06:59:48.191512 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.191409 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c46489cd5-j68pq: secret "image-registry-tls" not found Jul 07 06:59:48.191512 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.191446 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 06:59:56.191427462 +0000 UTC m=+69.616640710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : secret "router-metrics-certs-default" not found Jul 07 06:59:48.191512 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:48.191461 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls podName:cd30f27a-ce33-458b-8b0c-90c12d3a2c96 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:56.191454293 +0000 UTC m=+69.616667541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls") pod "image-registry-c46489cd5-j68pq" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96") : secret "image-registry-tls" not found Jul 07 06:59:48.372092 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:48.372021 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-625xq" Jul 07 06:59:49.098602 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:49.098555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:49.098996 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:49.098655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:49.098996 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:49.098683 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:59:49.098996 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:49.098749 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:51.098735221 +0000 UTC m=+64.523948491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : configmap "kube-rbac-proxy" not found Jul 07 06:59:49.098996 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:49.098812 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:59:49.098996 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:49.098867 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:51.098854822 +0000 UTC m=+64.524068070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : secret "insights-runtime-extractor-tls" not found Jul 07 06:59:50.223477 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:50.223449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8hjwm_89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e/dns-node-resolver/0.log" Jul 07 06:59:51.115753 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:51.115705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:51.115940 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:51.115778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:51.115940 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:51.115830 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:59:51.115940 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:51.115891 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:55.115875631 +0000 UTC m=+68.541088898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : configmap "kube-rbac-proxy" not found Jul 07 06:59:51.115940 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:51.115930 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:59:51.116077 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:51.115984 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 06:59:55.11597209 +0000 UTC m=+68.541185336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : secret "insights-runtime-extractor-tls" not found Jul 07 06:59:51.422802 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:51.422733 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf7db_b9072c5b-67b1-41cc-80c9-503b7096c72d/node-ca/0.log" Jul 07 06:59:51.822594 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:51.822565 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-29ghm_e484a269-46ab-4d05-9c32-6ab0c7e58d7e/serve-healthcheck-canary/0.log" Jul 07 06:59:52.831018 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.830980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:52.833770 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.833736 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 06:59:52.844627 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.844607 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 06:59:52.855249 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.855228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjq4g\" (UniqueName: \"kubernetes.io/projected/0ecade35-d968-4d62-99fc-ebcf0a17cff8-kube-api-access-sjq4g\") pod \"network-check-target-pgrb2\" (UID: \"0ecade35-d968-4d62-99fc-ebcf0a17cff8\") " pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:52.931638 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.931578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 06:59:52.931638 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.931647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:52.934868 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.934847 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 06:59:52.935466 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.935453 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 06:59:52.942027 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:52.942007 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 06:59:52.942104 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:52.942069 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs podName:e3e6926b-be32-403e-a606-04a5a6d3369b nodeName:}" failed. No retries permitted until 2026-07-07 07:00:56.942053542 +0000 UTC m=+130.367266793 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs") pod "network-metrics-daemon-6tjjb" (UID: "e3e6926b-be32-403e-a606-04a5a6d3369b") : secret "metrics-daemon-secret" not found Jul 07 06:59:52.944151 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:52.944133 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8619f98f-805f-4ce7-83e8-8b1de3672e14-original-pull-secret\") pod \"global-pull-secret-syncer-bfh2d\" (UID: \"8619f98f-805f-4ce7-83e8-8b1de3672e14\") " pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:53.139171 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:53.139093 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfh2d" Jul 07 06:59:53.146370 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:53.146347 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2lkzt\"" Jul 07 06:59:53.154295 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:53.154275 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:53.270809 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:53.270779 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfh2d"] Jul 07 06:59:53.275743 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:59:53.275712 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8619f98f_805f_4ce7_83e8_8b1de3672e14.slice/crio-6a7ebbde1f9bc6fdcb3fab9e6052b95cb0371dafe8196101c9b176c87816517a WatchSource:0}: Error finding container 6a7ebbde1f9bc6fdcb3fab9e6052b95cb0371dafe8196101c9b176c87816517a: Status 404 returned error can't find the container with id 6a7ebbde1f9bc6fdcb3fab9e6052b95cb0371dafe8196101c9b176c87816517a Jul 07 06:59:53.286305 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:53.286284 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pgrb2"] Jul 07 06:59:53.288620 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:59:53.288599 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecade35_d968_4d62_99fc_ebcf0a17cff8.slice/crio-045698658a88e3e5de60f1b4f13fcecc97f3d6effcad35e3a96237e7e8996a54 WatchSource:0}: Error finding container 045698658a88e3e5de60f1b4f13fcecc97f3d6effcad35e3a96237e7e8996a54: Status 404 returned error can't find the container with id 045698658a88e3e5de60f1b4f13fcecc97f3d6effcad35e3a96237e7e8996a54 Jul 07 06:59:53.463413 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:53.463317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfh2d" event={"ID":"8619f98f-805f-4ce7-83e8-8b1de3672e14","Type":"ContainerStarted","Data":"6a7ebbde1f9bc6fdcb3fab9e6052b95cb0371dafe8196101c9b176c87816517a"} Jul 07 06:59:53.464288 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:53.464264 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgrb2" event={"ID":"0ecade35-d968-4d62-99fc-ebcf0a17cff8","Type":"ContainerStarted","Data":"045698658a88e3e5de60f1b4f13fcecc97f3d6effcad35e3a96237e7e8996a54"} Jul 07 06:59:53.739431 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:53.739350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 06:59:53.739606 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:53.739542 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 06:59:53.739658 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:53.739644 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls podName:ff0cbbb7-f327-4c1e-a923-501328a5803e nodeName:}" failed. No retries permitted until 2026-07-07 07:00:25.739622491 +0000 UTC m=+99.164835752 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls") pod "dns-default-drl6g" (UID: "ff0cbbb7-f327-4c1e-a923-501328a5803e") : secret "dns-default-metrics-tls" not found Jul 07 06:59:55.152177 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:55.152135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:55.152656 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:55.152271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 06:59:55.152656 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:55.152310 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 06:59:55.152656 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:55.152354 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 06:59:55.152656 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:55.152387 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 07:00:03.152366533 +0000 UTC m=+76.577579779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : secret "insights-runtime-extractor-tls" not found Jul 07 06:59:55.152656 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:55.152411 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm podName:d5da8052-2965-416d-b290-d79c85a59e68 nodeName:}" failed. No retries permitted until 2026-07-07 07:00:03.152400545 +0000 UTC m=+76.577613793 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dp2zz" (UID: "d5da8052-2965-416d-b290-d79c85a59e68") : configmap "kube-rbac-proxy" not found Jul 07 06:59:56.262182 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.262147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:56.262647 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.262205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:56.262647 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.262245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:56.262647 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.262296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 06:59:56.262647 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:56.262392 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 06:59:56.262647 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:56.262471 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 07:00:12.262451772 +0000 UTC m=+85.687665033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : secret "router-metrics-certs-default" not found Jul 07 06:59:56.262647 ip-10-0-138-175 kubenswrapper[2565]: E0707 06:59:56.262491 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle podName:7a1f9c3e-403d-4bc1-89a3-3d48e64530dd nodeName:}" failed. No retries permitted until 2026-07-07 07:00:12.262480731 +0000 UTC m=+85.687693981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle") pod "router-default-dcff594f7-w7xr6" (UID: "7a1f9c3e-403d-4bc1-89a3-3d48e64530dd") : configmap references non-existent config key: service-ca.crt Jul 07 06:59:56.264861 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.264837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"image-registry-c46489cd5-j68pq\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:56.264961 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.264880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7a6b442-6b4c-4bb0-878b-18a77f8894d7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mpnsz\" (UID: \"d7a6b442-6b4c-4bb0-878b-18a77f8894d7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:56.347236 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.347206 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k67rb\"" Jul 07 06:59:56.354992 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.354965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" Jul 07 06:59:56.402794 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.402768 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7j9bg\"" Jul 07 06:59:56.411597 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:56.411567 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:58.148292 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.148224 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz"] Jul 07 06:59:58.164471 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.164444 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c46489cd5-j68pq"] Jul 07 06:59:58.167984 ip-10-0-138-175 kubenswrapper[2565]: W0707 06:59:58.167952 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd30f27a_ce33_458b_8b0c_90c12d3a2c96.slice/crio-53ae239584e3c0647b6e9b8a221bee4ccf528b3c92560cf6017858a565d84311 WatchSource:0}: Error finding container 53ae239584e3c0647b6e9b8a221bee4ccf528b3c92560cf6017858a565d84311: Status 404 returned error can't find the container with id 53ae239584e3c0647b6e9b8a221bee4ccf528b3c92560cf6017858a565d84311 Jul 07 06:59:58.479058 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.479020 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfh2d" event={"ID":"8619f98f-805f-4ce7-83e8-8b1de3672e14","Type":"ContainerStarted","Data":"4415d793b5e031a36d13f026999f47a1f02de21724b04972410e5ec44b947b05"} Jul 07 06:59:58.480215 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.480175 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" event={"ID":"d7a6b442-6b4c-4bb0-878b-18a77f8894d7","Type":"ContainerStarted","Data":"fbc722cb6203d356360cf3e1e0aedc012db66b9e5246f961f061cfd27a78bd07"} Jul 07 06:59:58.481736 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.481710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pgrb2" event={"ID":"0ecade35-d968-4d62-99fc-ebcf0a17cff8","Type":"ContainerStarted","Data":"b4b5dba065c07cd7fb32512b33478e4ed2da143c38072fcccb4621e534d37d33"} Jul 07 06:59:58.481864 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.481845 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 06:59:58.483237 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.483216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" event={"ID":"cd30f27a-ce33-458b-8b0c-90c12d3a2c96","Type":"ContainerStarted","Data":"2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf"} Jul 07 06:59:58.483332 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.483249 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" event={"ID":"cd30f27a-ce33-458b-8b0c-90c12d3a2c96","Type":"ContainerStarted","Data":"53ae239584e3c0647b6e9b8a221bee4ccf528b3c92560cf6017858a565d84311"} Jul 07 06:59:58.483464 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.483361 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 06:59:58.497408 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.497348 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bfh2d" podStartSLOduration=66.756807435 podStartE2EDuration="1m11.497333554s" totalImagesPullingTime="4.740526119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:58.497095303 +0000 UTC m=+71.922308572" watchObservedRunningTime="2026-07-07 06:59:58.497333554 +0000 UTC m=+71.922546823" Jul 07 06:59:58.520826 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.520776 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" podStartSLOduration=18.520761472 podStartE2EDuration="18.520761472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:59:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:58.519533843 +0000 UTC m=+71.944747112" watchObservedRunningTime="2026-07-07 06:59:58.520761472 +0000 UTC m=+71.945974741" Jul 07 06:59:58.538303 ip-10-0-138-175 kubenswrapper[2565]: I0707 06:59:58.538257 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pgrb2" podStartSLOduration=66.817972335 podStartE2EDuration="1m11.538243517s" totalImagesPullingTime="4.720271182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 06:59:58.537173931 +0000 UTC m=+71.962387202" watchObservedRunningTime="2026-07-07 06:59:58.538243517 +0000 UTC m=+71.963456780" Jul 07 07:00:00.490256 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:00.490221 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" event={"ID":"d7a6b442-6b4c-4bb0-878b-18a77f8894d7","Type":"ContainerStarted","Data":"2c241dedf3166fed54d296df60a91eaea808645ef6e30c652990a8928344c062"} Jul 07 07:00:00.490681 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:00.490298 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" event={"ID":"d7a6b442-6b4c-4bb0-878b-18a77f8894d7","Type":"ContainerStarted","Data":"7a8b50c14cc194a257323b1ccc42415dcbbd3339fc1175459ede7df26f39504c"} Jul 07 07:00:00.509994 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:00.509946 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mpnsz" podStartSLOduration=18.752523271 podStartE2EDuration="20.509930456s" totalImagesPullingTime="1.757407185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:00.5098129 +0000 UTC m=+73.935026173" watchObservedRunningTime="2026-07-07 07:00:00.509930456 +0000 UTC m=+73.935143726" Jul 07 07:00:03.220462 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:03.220412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 07:00:03.220982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:03.220498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 07:00:03.220982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:03.220945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5da8052-2965-416d-b290-d79c85a59e68-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 07:00:03.222853 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:03.222831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5da8052-2965-416d-b290-d79c85a59e68-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dp2zz\" (UID: \"d5da8052-2965-416d-b290-d79c85a59e68\") " pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 07:00:03.367040 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:03.366989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dp2zz" Jul 07 07:00:03.494635 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:03.494547 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dp2zz"] Jul 07 07:00:03.497950 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:03.497925 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5da8052_2965_416d_b290_d79c85a59e68.slice/crio-7a9ff46c9b813aa9ac3963ef5986615cc6494d46ad702b0f9e41deb5d822f8d8 WatchSource:0}: Error finding container 7a9ff46c9b813aa9ac3963ef5986615cc6494d46ad702b0f9e41deb5d822f8d8: Status 404 returned error can't find the container with id 7a9ff46c9b813aa9ac3963ef5986615cc6494d46ad702b0f9e41deb5d822f8d8 Jul 07 07:00:04.504860 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:04.504808 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp2zz" event={"ID":"d5da8052-2965-416d-b290-d79c85a59e68","Type":"ContainerStarted","Data":"7a9ff46c9b813aa9ac3963ef5986615cc6494d46ad702b0f9e41deb5d822f8d8"} Jul 07 07:00:08.519192 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:08.519159 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp2zz" event={"ID":"d5da8052-2965-416d-b290-d79c85a59e68","Type":"ContainerStarted","Data":"d6476bb2f9c27f7b14520046f55e7cd10a7172e6c0bdaeae952060ca7f381664"} Jul 07 07:00:08.519563 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:08.519215 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp2zz" event={"ID":"d5da8052-2965-416d-b290-d79c85a59e68","Type":"ContainerStarted","Data":"dc00aeacb5c42261511eba53c8ee7c3bd0ca38f83bec982c7b2792b21bba526e"} Jul 07 07:00:09.751656 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.751516 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c46489cd5-j68pq"] Jul 07 07:00:09.840673 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.840636 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66d564749-ln86g"] Jul 07 07:00:09.844925 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.844899 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-v8lgt"] Jul 07 07:00:09.845085 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.845038 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:09.847996 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.847973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-v8lgt" Jul 07 07:00:09.850539 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.850517 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 07:00:09.850669 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.850600 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 07:00:09.851017 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.850988 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gplgc\"" Jul 07 07:00:09.880262 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.880231 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66d564749-ln86g"] Jul 07 07:00:09.884102 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.884076 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-v8lgt"] Jul 07 07:00:09.980224 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fac45567-ed8f-48da-b083-d9d07f8085aa-registry-certificates\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:09.980408 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fac45567-ed8f-48da-b083-d9d07f8085aa-image-registry-private-configuration\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:09.980408 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fac45567-ed8f-48da-b083-d9d07f8085aa-installation-pull-secrets\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:09.980408 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fac45567-ed8f-48da-b083-d9d07f8085aa-trusted-ca\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:09.980408 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-bound-sa-token\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:09.980408 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9xhd\" (UniqueName: \"kubernetes.io/projected/2a6c1d23-522c-40e6-9fcb-95fc8afc8255-kube-api-access-m9xhd\") pod \"downloads-685bfb5f64-v8lgt\" (UID: \"2a6c1d23-522c-40e6-9fcb-95fc8afc8255\") " pod="openshift-console/downloads-685bfb5f64-v8lgt" Jul 07 07:00:09.980684 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fac45567-ed8f-48da-b083-d9d07f8085aa-ca-trust-extracted\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:09.980684 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q92ds\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-kube-api-access-q92ds\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:09.980684 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:09.980535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-registry-tls\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.081641 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fac45567-ed8f-48da-b083-d9d07f8085aa-ca-trust-extracted\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.081820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q92ds\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-kube-api-access-q92ds\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.081820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-registry-tls\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.081820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fac45567-ed8f-48da-b083-d9d07f8085aa-registry-certificates\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.081820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081821 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fac45567-ed8f-48da-b083-d9d07f8085aa-image-registry-private-configuration\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.082023 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fac45567-ed8f-48da-b083-d9d07f8085aa-installation-pull-secrets\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.082023 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fac45567-ed8f-48da-b083-d9d07f8085aa-trusted-ca\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.082023 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-bound-sa-token\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.082023 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.081904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9xhd\" (UniqueName: \"kubernetes.io/projected/2a6c1d23-522c-40e6-9fcb-95fc8afc8255-kube-api-access-m9xhd\") pod \"downloads-685bfb5f64-v8lgt\" (UID: \"2a6c1d23-522c-40e6-9fcb-95fc8afc8255\") " pod="openshift-console/downloads-685bfb5f64-v8lgt" Jul 07 07:00:10.082229 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.082059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fac45567-ed8f-48da-b083-d9d07f8085aa-ca-trust-extracted\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.082758 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.082714 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fac45567-ed8f-48da-b083-d9d07f8085aa-registry-certificates\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.083044 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.083022 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fac45567-ed8f-48da-b083-d9d07f8085aa-trusted-ca\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.084798 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.084774 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fac45567-ed8f-48da-b083-d9d07f8085aa-image-registry-private-configuration\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.084896 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.084815 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-registry-tls\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.085450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.085428 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fac45567-ed8f-48da-b083-d9d07f8085aa-installation-pull-secrets\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.100281 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.100257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-bound-sa-token\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.100671 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.100646 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q92ds\" (UniqueName: \"kubernetes.io/projected/fac45567-ed8f-48da-b083-d9d07f8085aa-kube-api-access-q92ds\") pod \"image-registry-66d564749-ln86g\" (UID: \"fac45567-ed8f-48da-b083-d9d07f8085aa\") " pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.101046 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.101024 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9xhd\" (UniqueName: \"kubernetes.io/projected/2a6c1d23-522c-40e6-9fcb-95fc8afc8255-kube-api-access-m9xhd\") pod \"downloads-685bfb5f64-v8lgt\" (UID: \"2a6c1d23-522c-40e6-9fcb-95fc8afc8255\") " pod="openshift-console/downloads-685bfb5f64-v8lgt" Jul 07 07:00:10.157264 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.157229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:10.163517 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.163496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-v8lgt" Jul 07 07:00:10.299980 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:10.299952 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66d564749-ln86g"] Jul 07 07:00:11.241635 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:11.241578 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac45567_ed8f_48da_b083_d9d07f8085aa.slice/crio-ed709f332e7076d2e07ad3d444ace660615fed807e7085811d0aac3a69ffe83c WatchSource:0}: Error finding container ed709f332e7076d2e07ad3d444ace660615fed807e7085811d0aac3a69ffe83c: Status 404 returned error can't find the container with id ed709f332e7076d2e07ad3d444ace660615fed807e7085811d0aac3a69ffe83c Jul 07 07:00:11.386241 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:11.386211 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-v8lgt"] Jul 07 07:00:11.391327 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:11.391305 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6c1d23_522c_40e6_9fcb_95fc8afc8255.slice/crio-cc3155c4810c39c9cc50c0bdcdb32884fd4c5eb4b3e8946eedb89ec495a539e3 WatchSource:0}: Error finding container cc3155c4810c39c9cc50c0bdcdb32884fd4c5eb4b3e8946eedb89ec495a539e3: Status 404 returned error can't find the container with id cc3155c4810c39c9cc50c0bdcdb32884fd4c5eb4b3e8946eedb89ec495a539e3 Jul 07 07:00:11.532936 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:11.532854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dp2zz" event={"ID":"d5da8052-2965-416d-b290-d79c85a59e68","Type":"ContainerStarted","Data":"b74a4c1ec29809978dd19faa37500aa24cdbb162b28cce80e61edcd88d4a6312"} Jul 07 07:00:11.534175 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:11.534150 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-v8lgt" event={"ID":"2a6c1d23-522c-40e6-9fcb-95fc8afc8255","Type":"ContainerStarted","Data":"cc3155c4810c39c9cc50c0bdcdb32884fd4c5eb4b3e8946eedb89ec495a539e3"} Jul 07 07:00:11.535538 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:11.535519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d564749-ln86g" event={"ID":"fac45567-ed8f-48da-b083-d9d07f8085aa","Type":"ContainerStarted","Data":"dae294447e5940e27b6e202c30f68bb471818c35d06494925fb7e23ed57c68f5"} Jul 07 07:00:11.535636 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:11.535548 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d564749-ln86g" event={"ID":"fac45567-ed8f-48da-b083-d9d07f8085aa","Type":"ContainerStarted","Data":"ed709f332e7076d2e07ad3d444ace660615fed807e7085811d0aac3a69ffe83c"} Jul 07 07:00:11.535636 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:11.535601 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:11.571884 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:11.571828 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dp2zz" podStartSLOduration=16.878275338 podStartE2EDuration="24.571810527s" totalImagesPullingTime="7.693535189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 06:59:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:11.57132237 +0000 UTC m=+84.996535641" watchObservedRunningTime="2026-07-07 07:00:11.571810527 +0000 UTC m=+84.997023797" Jul 07 07:00:11.609660 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:11.609609 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66d564749-ln86g" podStartSLOduration=2.609574496 podStartE2EDuration="2.609574496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:11.608419985 +0000 UTC m=+85.033633253" watchObservedRunningTime="2026-07-07 07:00:11.609574496 +0000 UTC m=+85.034787764" Jul 07 07:00:12.301667 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:12.301621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:12.302025 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:12.301685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:12.302267 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:12.302247 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-service-ca-bundle\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:12.303923 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:12.303904 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a1f9c3e-403d-4bc1-89a3-3d48e64530dd-metrics-certs\") pod \"router-default-dcff594f7-w7xr6\" (UID: \"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd\") " pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:12.570263 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:12.570181 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9cq26\"" Jul 07 07:00:12.578040 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:12.578011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:12.720062 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:12.720034 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dcff594f7-w7xr6"] Jul 07 07:00:12.723217 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:12.723188 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1f9c3e_403d_4bc1_89a3_3d48e64530dd.slice/crio-a3f01a00f247ff6f1cbdcda31c4ba38970db3b9dbdac1bd7b256c9e8a027aa81 WatchSource:0}: Error finding container a3f01a00f247ff6f1cbdcda31c4ba38970db3b9dbdac1bd7b256c9e8a027aa81: Status 404 returned error can't find the container with id a3f01a00f247ff6f1cbdcda31c4ba38970db3b9dbdac1bd7b256c9e8a027aa81 Jul 07 07:00:13.544766 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:13.544729 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dcff594f7-w7xr6" event={"ID":"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd","Type":"ContainerStarted","Data":"e28e2ec41efed121e6811cbb9fcd8476238e52bcd2897985fbcdec80734c65aa"} Jul 07 07:00:13.545232 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:13.544782 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dcff594f7-w7xr6" event={"ID":"7a1f9c3e-403d-4bc1-89a3-3d48e64530dd","Type":"ContainerStarted","Data":"a3f01a00f247ff6f1cbdcda31c4ba38970db3b9dbdac1bd7b256c9e8a027aa81"} Jul 07 07:00:13.571627 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:13.571545 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-dcff594f7-w7xr6" podStartSLOduration=33.571522573 podStartE2EDuration="33.571522573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:59:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:13.570121154 +0000 UTC m=+86.995334422" watchObservedRunningTime="2026-07-07 07:00:13.571522573 +0000 UTC m=+86.996735842" Jul 07 07:00:13.578876 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:13.578809 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:13.581438 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:13.581417 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:14.548337 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:14.548307 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:14.549655 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:14.549633 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-dcff594f7-w7xr6" Jul 07 07:00:16.969709 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.969673 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-669f8fdcbd-bw7k8"] Jul 07 07:00:16.974558 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.974529 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:16.977312 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.977281 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 07:00:16.977420 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.977326 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 07:00:16.978067 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.978027 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 07:00:16.978067 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.978061 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jh5lq\"" Jul 07 07:00:16.978239 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.978077 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 07:00:16.978239 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.978114 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 07:00:16.984524 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:16.984494 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669f8fdcbd-bw7k8"] Jul 07 07:00:17.142266 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.142236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-oauth-config\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.142448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.142293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-oauth-serving-cert\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.142448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.142318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dhc\" (UniqueName: \"kubernetes.io/projected/da651968-da32-4079-b22b-2d964e9f569a-kube-api-access-j7dhc\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.142448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.142374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-console-config\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.142448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.142438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-service-ca\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.142639 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.142479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-serving-cert\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.243009 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.242923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-oauth-config\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.243009 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.243000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-oauth-serving-cert\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.243222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.243024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dhc\" (UniqueName: \"kubernetes.io/projected/da651968-da32-4079-b22b-2d964e9f569a-kube-api-access-j7dhc\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.243222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.243058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-console-config\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.243222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.243112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-service-ca\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.243222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.243151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-serving-cert\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.243961 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.243893 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-oauth-serving-cert\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.243961 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.243925 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-console-config\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.244132 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.243985 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-service-ca\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.245915 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.245888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-serving-cert\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.246033 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.245919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-oauth-config\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.259889 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.259863 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dhc\" (UniqueName: \"kubernetes.io/projected/da651968-da32-4079-b22b-2d964e9f569a-kube-api-access-j7dhc\") pod \"console-669f8fdcbd-bw7k8\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.285909 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.285878 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:17.439521 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.439377 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669f8fdcbd-bw7k8"] Jul 07 07:00:17.442236 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:17.442210 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda651968_da32_4079_b22b_2d964e9f569a.slice/crio-37fac901665b11992f419f700116f690b61d6c36b4dafded9bb3d07e1408e466 WatchSource:0}: Error finding container 37fac901665b11992f419f700116f690b61d6c36b4dafded9bb3d07e1408e466: Status 404 returned error can't find the container with id 37fac901665b11992f419f700116f690b61d6c36b4dafded9bb3d07e1408e466 Jul 07 07:00:17.559350 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:17.559261 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669f8fdcbd-bw7k8" event={"ID":"da651968-da32-4079-b22b-2d964e9f569a","Type":"ContainerStarted","Data":"37fac901665b11992f419f700116f690b61d6c36b4dafded9bb3d07e1408e466"} Jul 07 07:00:19.758812 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:19.758783 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 07:00:20.903844 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:20.903759 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh"] Jul 07 07:00:20.907020 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:20.906989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" Jul 07 07:00:20.909985 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:20.909959 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7qrg5\"" Jul 07 07:00:20.910106 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:20.909967 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 07:00:20.919513 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:20.919492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh"] Jul 07 07:00:21.079225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:21.079181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04b74bba-22de-4113-aa65-4e2e3d6983ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-j9sjh\" (UID: \"04b74bba-22de-4113-aa65-4e2e3d6983ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" Jul 07 07:00:21.179808 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:21.179730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04b74bba-22de-4113-aa65-4e2e3d6983ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-j9sjh\" (UID: \"04b74bba-22de-4113-aa65-4e2e3d6983ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" Jul 07 07:00:21.182328 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:21.182297 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04b74bba-22de-4113-aa65-4e2e3d6983ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-j9sjh\" (UID: \"04b74bba-22de-4113-aa65-4e2e3d6983ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" Jul 07 07:00:21.217232 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:21.217203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" Jul 07 07:00:21.388450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:21.388420 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh"] Jul 07 07:00:21.391913 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:21.391882 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b74bba_22de_4113_aa65_4e2e3d6983ea.slice/crio-eb266a32d31fb00625b0dc4609fd22f6e5c9d5dc50980fcf4ee435a97994da13 WatchSource:0}: Error finding container eb266a32d31fb00625b0dc4609fd22f6e5c9d5dc50980fcf4ee435a97994da13: Status 404 returned error can't find the container with id eb266a32d31fb00625b0dc4609fd22f6e5c9d5dc50980fcf4ee435a97994da13 Jul 07 07:00:21.576415 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:21.576369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669f8fdcbd-bw7k8" event={"ID":"da651968-da32-4079-b22b-2d964e9f569a","Type":"ContainerStarted","Data":"11b46943cb4a69cd1781da6e09c44ddd946401df9f009e4c75b8bdfc6ed1cbed"} Jul 07 07:00:21.577676 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:21.577649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" event={"ID":"04b74bba-22de-4113-aa65-4e2e3d6983ea","Type":"ContainerStarted","Data":"eb266a32d31fb00625b0dc4609fd22f6e5c9d5dc50980fcf4ee435a97994da13"} Jul 07 07:00:21.602863 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:21.602815 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-669f8fdcbd-bw7k8" podStartSLOduration=2.442443351 podStartE2EDuration="5.602799925s" totalImagesPullingTime="3.160356574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:21.601806783 +0000 UTC m=+95.027020057" watchObservedRunningTime="2026-07-07 07:00:21.602799925 +0000 UTC m=+95.028013172" Jul 07 07:00:25.824097 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:25.824047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 07:00:25.826668 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:25.826643 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff0cbbb7-f327-4c1e-a923-501328a5803e-metrics-tls\") pod \"dns-default-drl6g\" (UID: \"ff0cbbb7-f327-4c1e-a923-501328a5803e\") " pod="openshift-dns/dns-default-drl6g" Jul 07 07:00:26.093651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:26.093556 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vfjqn\"" Jul 07 07:00:26.101780 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:26.101757 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-drl6g" Jul 07 07:00:27.285990 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:27.285956 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:27.286398 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:27.286021 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:27.294419 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:27.294388 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:27.604225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:27.604198 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:29.112137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:29.112103 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-drl6g"] Jul 07 07:00:29.115450 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:29.115422 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0cbbb7_f327_4c1e_a923_501328a5803e.slice/crio-cfb00f4cca5d88f89af058cfa709a70e236551bd44e5d9add585ff88314ee434 WatchSource:0}: Error finding container cfb00f4cca5d88f89af058cfa709a70e236551bd44e5d9add585ff88314ee434: Status 404 returned error can't find the container with id cfb00f4cca5d88f89af058cfa709a70e236551bd44e5d9add585ff88314ee434 Jul 07 07:00:29.488724 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:29.488693 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pgrb2" Jul 07 07:00:29.610057 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:29.610014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-v8lgt" event={"ID":"2a6c1d23-522c-40e6-9fcb-95fc8afc8255","Type":"ContainerStarted","Data":"a3e1d2142627c9594c22c0bdcb9c3413463ec72a4c3eeb09c7ed96c73f0cb790"} Jul 07 07:00:29.610248 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:29.610078 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-v8lgt" Jul 07 07:00:29.611578 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:29.611547 2565 patch_prober.go:28] interesting pod/downloads-685bfb5f64-v8lgt container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body= Jul 07 07:00:29.611732 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:29.611624 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-v8lgt" podUID="2a6c1d23-522c-40e6-9fcb-95fc8afc8255" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" Jul 07 07:00:29.611799 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:29.611771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drl6g" event={"ID":"ff0cbbb7-f327-4c1e-a923-501328a5803e","Type":"ContainerStarted","Data":"cfb00f4cca5d88f89af058cfa709a70e236551bd44e5d9add585ff88314ee434"} Jul 07 07:00:30.618483 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:30.618442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" event={"ID":"04b74bba-22de-4113-aa65-4e2e3d6983ea","Type":"ContainerStarted","Data":"a3922a12006ef3ada979370e0d7929ae1c1935bcbd14467faef9a82c129dc4a6"} Jul 07 07:00:30.619005 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:30.618500 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" Jul 07 07:00:30.621208 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:30.621186 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-v8lgt" Jul 07 07:00:30.625604 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:30.625167 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" Jul 07 07:00:30.643992 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:30.643941 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-v8lgt" podStartSLOduration=3.661070927 podStartE2EDuration="21.643922272s" totalImagesPullingTime="17.982851345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:29.635673245 +0000 UTC m=+103.060886515" watchObservedRunningTime="2026-07-07 07:00:30.643922272 +0000 UTC m=+104.069135544" Jul 07 07:00:30.644356 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:30.644321 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j9sjh" podStartSLOduration=2.018214938 podStartE2EDuration="10.644311005s" totalImagesPullingTime="8.626096067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:30.643171082 +0000 UTC m=+104.068384354" watchObservedRunningTime="2026-07-07 07:00:30.644311005 +0000 UTC m=+104.069524276" Jul 07 07:00:32.547219 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:32.547195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66d564749-ln86g" Jul 07 07:00:32.630380 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:32.630331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drl6g" event={"ID":"ff0cbbb7-f327-4c1e-a923-501328a5803e","Type":"ContainerStarted","Data":"9daa5630652610c4b7ad74c428c879f04483312ebcb92d2fbb47d809fd3e8e3d"} Jul 07 07:00:32.630547 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:32.630408 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-drl6g" Jul 07 07:00:32.630547 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:32.630436 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-drl6g" event={"ID":"ff0cbbb7-f327-4c1e-a923-501328a5803e","Type":"ContainerStarted","Data":"f9a6df966fe551cd106c7b5025d4451c90208957327e595e93c00dd22c17ee9c"} Jul 07 07:00:32.654228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:32.654182 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-drl6g" podStartSLOduration=68.467432606 podStartE2EDuration="1m11.654165228s" totalImagesPullingTime="3.186732622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:32.653357576 +0000 UTC m=+106.078570845" watchObservedRunningTime="2026-07-07 07:00:32.654165228 +0000 UTC m=+106.079378496" Jul 07 07:00:34.571506 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:34.571469 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669f8fdcbd-bw7k8"] Jul 07 07:00:34.774820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:34.774764 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" podUID="cd30f27a-ce33-458b-8b0c-90c12d3a2c96" containerName="registry" containerID="cri-o://2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf" gracePeriod=30 Jul 07 07:00:35.069912 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.069882 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 07:00:35.098686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.098652 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-trusted-ca\") pod \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " Jul 07 07:00:35.098862 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.098716 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-certificates\") pod \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " Jul 07 07:00:35.098862 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.098758 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-installation-pull-secrets\") pod \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " Jul 07 07:00:35.098862 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.098788 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h78k7\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-kube-api-access-h78k7\") pod \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " Jul 07 07:00:35.098862 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.098815 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") pod \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " Jul 07 07:00:35.098862 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.098850 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-ca-trust-extracted\") pod \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " Jul 07 07:00:35.099124 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.098883 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-image-registry-private-configuration\") pod \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " Jul 07 07:00:35.099124 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.098940 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-bound-sa-token\") pod \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\" (UID: \"cd30f27a-ce33-458b-8b0c-90c12d3a2c96\") " Jul 07 07:00:35.099124 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.099091 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cd30f27a-ce33-458b-8b0c-90c12d3a2c96" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:00:35.099264 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.099192 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-trusted-ca\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:00:35.099826 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.099781 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cd30f27a-ce33-458b-8b0c-90c12d3a2c96" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:00:35.102007 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.101962 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cd30f27a-ce33-458b-8b0c-90c12d3a2c96" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:00:35.102988 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.102943 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cd30f27a-ce33-458b-8b0c-90c12d3a2c96" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:00:35.104864 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.104824 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-kube-api-access-h78k7" (OuterVolumeSpecName: "kube-api-access-h78k7") pod "cd30f27a-ce33-458b-8b0c-90c12d3a2c96" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96"). InnerVolumeSpecName "kube-api-access-h78k7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:00:35.105495 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.105370 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cd30f27a-ce33-458b-8b0c-90c12d3a2c96" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:00:35.105495 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.105459 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cd30f27a-ce33-458b-8b0c-90c12d3a2c96" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:00:35.110780 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.110753 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cd30f27a-ce33-458b-8b0c-90c12d3a2c96" (UID: "cd30f27a-ce33-458b-8b0c-90c12d3a2c96"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:00:35.200439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.200356 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-ca-trust-extracted\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:00:35.200439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.200394 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-image-registry-private-configuration\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:00:35.200439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.200409 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-bound-sa-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:00:35.200439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.200423 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-certificates\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:00:35.200439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.200432 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-installation-pull-secrets\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:00:35.200439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.200440 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h78k7\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-kube-api-access-h78k7\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:00:35.200439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.200448 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd30f27a-ce33-458b-8b0c-90c12d3a2c96-registry-tls\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:00:35.396228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.396196 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk"] Jul 07 07:00:35.396481 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.396467 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd30f27a-ce33-458b-8b0c-90c12d3a2c96" containerName="registry" Jul 07 07:00:35.396481 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.396482 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd30f27a-ce33-458b-8b0c-90c12d3a2c96" containerName="registry" Jul 07 07:00:35.396616 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.396525 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd30f27a-ce33-458b-8b0c-90c12d3a2c96" containerName="registry" Jul 07 07:00:35.432970 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.432934 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk"] Jul 07 07:00:35.433134 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.433070 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.435826 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.435567 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 07:00:35.435826 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.435576 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 07:00:35.435826 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.435605 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ckv7d"] Jul 07 07:00:35.435826 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.435599 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 07:00:35.436496 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.436321 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 07:00:35.436496 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.436422 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 07:00:35.436692 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.436555 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kc9px\"" Jul 07 07:00:35.458773 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.458709 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w"] Jul 07 07:00:35.458903 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.458829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.461121 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.460957 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 07:00:35.461433 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.461413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bjwds\"" Jul 07 07:00:35.461538 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.461468 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 07:00:35.461799 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.461639 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 07:00:35.478825 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.478802 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w"] Jul 07 07:00:35.478940 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.478922 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.481374 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.481350 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-thhbj\"" Jul 07 07:00:35.481481 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.481388 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 07:00:35.481481 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.481427 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 07:00:35.481481 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.481350 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 07:00:35.502742 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.502712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-sys\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.502880 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.502745 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.502880 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.502814 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-root\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.502880 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.502840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.502880 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.502866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhxpf\" (UniqueName: \"kubernetes.io/projected/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-kube-api-access-rhxpf\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.503090 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.502932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.503090 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.502976 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.503090 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503004 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c391394-aa02-488e-9267-410b75525ade-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.503090 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9tfx\" (UniqueName: \"kubernetes.io/projected/0c391394-aa02-488e-9267-410b75525ade-kube-api-access-m9tfx\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.503090 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c391394-aa02-488e-9267-410b75525ade-node-exporter-textfile\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.503247 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.503247 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84a31cbf-7a28-4297-9b65-02953544e254-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.503247 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-tls\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.503247 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.503247 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.503463 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503250 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a31cbf-7a28-4297-9b65-02953544e254-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.503463 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503287 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg58l\" (UniqueName: \"kubernetes.io/projected/84a31cbf-7a28-4297-9b65-02953544e254-kube-api-access-pg58l\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.503463 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c391394-aa02-488e-9267-410b75525ade-metrics-client-ca\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.503463 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.503394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-node-exporter-wtmp\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.604631 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a31cbf-7a28-4297-9b65-02953544e254-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.604631 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg58l\" (UniqueName: \"kubernetes.io/projected/84a31cbf-7a28-4297-9b65-02953544e254-kube-api-access-pg58l\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604683 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c391394-aa02-488e-9267-410b75525ade-metrics-client-ca\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-node-exporter-wtmp\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-sys\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604798 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-root\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604827 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhxpf\" (UniqueName: \"kubernetes.io/projected/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-kube-api-access-rhxpf\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604908 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-node-exporter-wtmp\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c391394-aa02-488e-9267-410b75525ade-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9tfx\" (UniqueName: \"kubernetes.io/projected/0c391394-aa02-488e-9267-410b75525ade-kube-api-access-m9tfx\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-root\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c391394-aa02-488e-9267-410b75525ade-node-exporter-textfile\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.604854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c391394-aa02-488e-9267-410b75525ade-sys\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84a31cbf-7a28-4297-9b65-02953544e254-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-tls\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:00:35.605356 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605383 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a31cbf-7a28-4297-9b65-02953544e254-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:00:35.605411 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-tls podName:0c391394-aa02-488e-9267-410b75525ade nodeName:}" failed. No retries permitted until 2026-07-07 07:00:36.105394807 +0000 UTC m=+109.530608053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-tls") pod "node-exporter-ckv7d" (UID: "0c391394-aa02-488e-9267-410b75525ade") : secret "node-exporter-tls" not found Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c391394-aa02-488e-9267-410b75525ade-metrics-client-ca\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:00:35.605496 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605545 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c391394-aa02-488e-9267-410b75525ade-node-exporter-textfile\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:00:35.605574 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-tls podName:c02c2fa8-b68a-440e-a7dd-ec02eea2a906 nodeName:}" failed. No retries permitted until 2026-07-07 07:00:36.105557373 +0000 UTC m=+109.530770636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-w7tkk" (UID: "c02c2fa8-b68a-440e-a7dd-ec02eea2a906") : secret "openshift-state-metrics-tls" not found Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/84a31cbf-7a28-4297-9b65-02953544e254-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.605971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.605935 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c391394-aa02-488e-9267-410b75525ade-node-exporter-accelerators-collector-config\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.606698 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.606416 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.608007 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.607976 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.608119 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.608101 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.608297 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.608278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.608420 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.608399 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/84a31cbf-7a28-4297-9b65-02953544e254-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.619281 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.619257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhxpf\" (UniqueName: \"kubernetes.io/projected/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-kube-api-access-rhxpf\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:35.619393 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.619350 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg58l\" (UniqueName: \"kubernetes.io/projected/84a31cbf-7a28-4297-9b65-02953544e254-kube-api-access-pg58l\") pod \"kube-state-metrics-7c9dbb8b7d-d778w\" (UID: \"84a31cbf-7a28-4297-9b65-02953544e254\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.619447 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.619412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9tfx\" (UniqueName: \"kubernetes.io/projected/0c391394-aa02-488e-9267-410b75525ade-kube-api-access-m9tfx\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:35.644507 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.644473 2565 generic.go:356] "Generic (PLEG): container finished" podID="cd30f27a-ce33-458b-8b0c-90c12d3a2c96" containerID="2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf" exitCode=0 Jul 07 07:00:35.644658 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.644519 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" Jul 07 07:00:35.644658 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.644516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" event={"ID":"cd30f27a-ce33-458b-8b0c-90c12d3a2c96","Type":"ContainerDied","Data":"2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf"} Jul 07 07:00:35.644658 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.644646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c46489cd5-j68pq" event={"ID":"cd30f27a-ce33-458b-8b0c-90c12d3a2c96","Type":"ContainerDied","Data":"53ae239584e3c0647b6e9b8a221bee4ccf528b3c92560cf6017858a565d84311"} Jul 07 07:00:35.644806 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.644692 2565 scope.go:117] "RemoveContainer" containerID="2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf" Jul 07 07:00:35.653800 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.653780 2565 scope.go:117] "RemoveContainer" containerID="2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf" Jul 07 07:00:35.654066 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:00:35.654045 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf\": container with ID starting with 2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf not found: ID does not exist" containerID="2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf" Jul 07 07:00:35.654145 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.654077 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf"} err="failed to get container status \"2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf\": rpc error: code = NotFound desc = could not find container \"2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf\": container with ID starting with 2817093a9810c692ea75c39d6ce11a6f938a9470b05484a365a97c5cae2e2daf not found: ID does not exist" Jul 07 07:00:35.664540 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.664509 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c46489cd5-j68pq"] Jul 07 07:00:35.672733 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.672707 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c46489cd5-j68pq"] Jul 07 07:00:35.789544 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.789469 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" Jul 07 07:00:35.999958 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:35.999925 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w"] Jul 07 07:00:36.003871 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:36.003836 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a31cbf_7a28_4297_9b65_02953544e254.slice/crio-59205f8fadfa62bc36640ab78cbfef9959b063f812d5a48b9f00f24e85b46866 WatchSource:0}: Error finding container 59205f8fadfa62bc36640ab78cbfef9959b063f812d5a48b9f00f24e85b46866: Status 404 returned error can't find the container with id 59205f8fadfa62bc36640ab78cbfef9959b063f812d5a48b9f00f24e85b46866 Jul 07 07:00:36.110685 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.110648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-tls\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:36.110882 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.110698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:36.113534 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.113509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c391394-aa02-488e-9267-410b75525ade-node-exporter-tls\") pod \"node-exporter-ckv7d\" (UID: \"0c391394-aa02-488e-9267-410b75525ade\") " pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:36.113684 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.113540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c02c2fa8-b68a-440e-a7dd-ec02eea2a906-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-w7tkk\" (UID: \"c02c2fa8-b68a-440e-a7dd-ec02eea2a906\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:36.344369 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.344330 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" Jul 07 07:00:36.370367 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.370288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ckv7d" Jul 07 07:00:36.416949 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:36.416913 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c391394_aa02_488e_9267_410b75525ade.slice/crio-490ebe57a2a7cfd164bf37aad2d71ade76f87871b2452249a4e9d21a2f6afdc4 WatchSource:0}: Error finding container 490ebe57a2a7cfd164bf37aad2d71ade76f87871b2452249a4e9d21a2f6afdc4: Status 404 returned error can't find the container with id 490ebe57a2a7cfd164bf37aad2d71ade76f87871b2452249a4e9d21a2f6afdc4 Jul 07 07:00:36.540824 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.540787 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk"] Jul 07 07:00:36.543869 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:36.543840 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02c2fa8_b68a_440e_a7dd_ec02eea2a906.slice/crio-c2244bfd2b0799dc5a5baabaf9133e52af7c49b3d164efc859bb659c5b680a5a WatchSource:0}: Error finding container c2244bfd2b0799dc5a5baabaf9133e52af7c49b3d164efc859bb659c5b680a5a: Status 404 returned error can't find the container with id c2244bfd2b0799dc5a5baabaf9133e52af7c49b3d164efc859bb659c5b680a5a Jul 07 07:00:36.562622 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.561097 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 07:00:36.603196 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.603164 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 07:00:36.603341 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.603315 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.606044 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.606019 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 07:00:36.606370 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.606045 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 07:00:36.606717 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.606669 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 07:00:36.606717 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.606696 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 07:00:36.606875 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.606669 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r2m87\"" Jul 07 07:00:36.606875 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.606822 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 07:00:36.606992 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.606896 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 07:00:36.607299 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.607079 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 07:00:36.607299 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.607140 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 07:00:36.607299 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.607229 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 07:00:36.614751 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.614726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-config-volume\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.614856 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.614797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-config-out\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.614917 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.614892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.614972 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.614929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.614972 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.614957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.615076 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.614984 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.615076 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.615006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.615076 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.615034 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-web-config\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.615221 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.615110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdzcs\" (UniqueName: \"kubernetes.io/projected/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-kube-api-access-bdzcs\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.615221 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.615145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.615221 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.615170 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.615354 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.615241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.615354 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.615314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.650440 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.650395 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckv7d" event={"ID":"0c391394-aa02-488e-9267-410b75525ade","Type":"ContainerStarted","Data":"490ebe57a2a7cfd164bf37aad2d71ade76f87871b2452249a4e9d21a2f6afdc4"} Jul 07 07:00:36.652029 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.652002 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" event={"ID":"84a31cbf-7a28-4297-9b65-02953544e254","Type":"ContainerStarted","Data":"59205f8fadfa62bc36640ab78cbfef9959b063f812d5a48b9f00f24e85b46866"} Jul 07 07:00:36.655075 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.655046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" event={"ID":"c02c2fa8-b68a-440e-a7dd-ec02eea2a906","Type":"ContainerStarted","Data":"c2244bfd2b0799dc5a5baabaf9133e52af7c49b3d164efc859bb659c5b680a5a"} Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.716743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-config-out\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.716807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.716832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.716863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.716892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.716916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.716945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-web-config\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.716980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdzcs\" (UniqueName: \"kubernetes.io/projected/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-kube-api-access-bdzcs\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.717021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.717044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.717082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.717123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.717167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-config-volume\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.718353 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:00:36.717473 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-trusted-ca-bundle podName:2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d nodeName:}" failed. No retries permitted until 2026-07-07 07:00:37.217448704 +0000 UTC m=+110.642661957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d") : configmap references non-existent config key: ca-bundle.crt Jul 07 07:00:36.719172 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.718913 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.720991 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.720674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.722743 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.722259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-config-out\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.722743 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.722532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-config-volume\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.722743 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.722694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.722958 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.722784 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.725204 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.724349 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.725204 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.724550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-web-config\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.725204 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.724877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.725204 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.724933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.726546 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.726452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:36.736785 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:36.736759 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdzcs\" (UniqueName: \"kubernetes.io/projected/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-kube-api-access-bdzcs\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:37.135216 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.135178 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd30f27a-ce33-458b-8b0c-90c12d3a2c96" path="/var/lib/kubelet/pods/cd30f27a-ce33-458b-8b0c-90c12d3a2c96/volumes" Jul 07 07:00:37.223248 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.223210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:37.224266 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.224236 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:37.408355 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.408274 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-9447d957d-rht4c"] Jul 07 07:00:37.427598 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.427540 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9447d957d-rht4c"] Jul 07 07:00:37.429228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.427754 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.432657 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.430134 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 07:00:37.432657 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.430405 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 07:00:37.432657 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.430665 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6vppc\"" Jul 07 07:00:37.432657 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.430884 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ai7ftf1c7h7ms\"" Jul 07 07:00:37.432657 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.431054 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 07:00:37.432657 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.431247 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 07:00:37.432657 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.431547 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 07:00:37.520669 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.520605 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 07:00:37.524915 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.524884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.525144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.524961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.525144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.524993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-tls\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.525144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.525030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j9wn\" (UniqueName: \"kubernetes.io/projected/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-kube-api-access-4j9wn\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.525144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.525057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.525144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.525086 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-metrics-client-ca\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.525144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.525107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-grpc-tls\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.525144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.525137 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.626204 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.626170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.626634 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.626230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.626634 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.626254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-tls\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.626634 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.626292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j9wn\" (UniqueName: \"kubernetes.io/projected/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-kube-api-access-4j9wn\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.626634 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.626320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.626634 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.626346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-metrics-client-ca\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.626634 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.626362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-grpc-tls\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.626634 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.626387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.627608 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.627522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-metrics-client-ca\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.629365 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.629308 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.629969 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.629919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.630204 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.630182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.630675 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.630651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-tls\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.631166 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.631142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.631228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.631197 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-secret-grpc-tls\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.637014 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.636991 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j9wn\" (UniqueName: \"kubernetes.io/projected/fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5-kube-api-access-4j9wn\") pod \"thanos-querier-9447d957d-rht4c\" (UID: \"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5\") " pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:37.661112 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.661046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" event={"ID":"c02c2fa8-b68a-440e-a7dd-ec02eea2a906","Type":"ContainerStarted","Data":"daebfc0858f913e3fed737fe2d7ee29b02cf2b079d26e3999f561e2a478feff3"} Jul 07 07:00:37.661217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.661135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" event={"ID":"c02c2fa8-b68a-440e-a7dd-ec02eea2a906","Type":"ContainerStarted","Data":"90542db927621f342256761e7aad8b8f3c88ae5b9cf402e93b5aa3286505fe90"} Jul 07 07:00:37.744947 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:37.744872 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:38.570135 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:38.570033 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 07:00:38.577519 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:38.577427 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9447d957d-rht4c"] Jul 07 07:00:38.583423 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:38.583256 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1a9ef3_3d5c_45f2_8d6a_0126c6ceb9c5.slice/crio-742988be5f4f6c33809891d81af77934d9a45e11616ea3d451d0d2190d67b79b WatchSource:0}: Error finding container 742988be5f4f6c33809891d81af77934d9a45e11616ea3d451d0d2190d67b79b: Status 404 returned error can't find the container with id 742988be5f4f6c33809891d81af77934d9a45e11616ea3d451d0d2190d67b79b Jul 07 07:00:38.668202 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:38.668172 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d","Type":"ContainerStarted","Data":"a502147bea0f71cf821ef5a2226d35d5304efa9bd0bbf8f2f089b3aaf9c046a0"} Jul 07 07:00:38.672409 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:38.672077 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" event={"ID":"84a31cbf-7a28-4297-9b65-02953544e254","Type":"ContainerStarted","Data":"dac0d6c466922717617c8c4685b8ddab4c40fb8e35df701fb92c0ecdd5391749"} Jul 07 07:00:38.672409 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:38.672204 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" event={"ID":"84a31cbf-7a28-4297-9b65-02953544e254","Type":"ContainerStarted","Data":"44f824241064aca5e51f32cfa20d88a40e41ac83f09e299b73385be82b2ef61f"} Jul 07 07:00:38.675704 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:38.675419 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" event={"ID":"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5","Type":"ContainerStarted","Data":"742988be5f4f6c33809891d81af77934d9a45e11616ea3d451d0d2190d67b79b"} Jul 07 07:00:38.678055 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:38.678030 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckv7d" event={"ID":"0c391394-aa02-488e-9267-410b75525ade","Type":"ContainerStarted","Data":"f0ddcef5a67461c3057cd40d336a1bbacdf10d1a7fc8aec5ce17744602b42a04"} Jul 07 07:00:39.686104 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.686007 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" event={"ID":"84a31cbf-7a28-4297-9b65-02953544e254","Type":"ContainerStarted","Data":"b1537afbf7755a799aab3e2eaa9fc23e81ebf9c3e7cc028380577e7f5c382d0a"} Jul 07 07:00:39.688644 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.688614 2565 generic.go:356] "Generic (PLEG): container finished" podID="0c391394-aa02-488e-9267-410b75525ade" containerID="f0ddcef5a67461c3057cd40d336a1bbacdf10d1a7fc8aec5ce17744602b42a04" exitCode=0 Jul 07 07:00:39.688778 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.688716 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckv7d" event={"ID":"0c391394-aa02-488e-9267-410b75525ade","Type":"ContainerDied","Data":"f0ddcef5a67461c3057cd40d336a1bbacdf10d1a7fc8aec5ce17744602b42a04"} Jul 07 07:00:39.693562 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.693537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" event={"ID":"c02c2fa8-b68a-440e-a7dd-ec02eea2a906","Type":"ContainerStarted","Data":"11e754ef38ca067991530d1b15e2a17e99b15c3f0466ed6e49c6453c13f031e3"} Jul 07 07:00:39.712920 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.712857 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d778w" podStartSLOduration=2.3454425260000002 podStartE2EDuration="4.712837093s" totalImagesPullingTime="2.367394567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:39.711853492 +0000 UTC m=+113.137066762" watchObservedRunningTime="2026-07-07 07:00:39.712837093 +0000 UTC m=+113.138050363" Jul 07 07:00:39.738235 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.737833 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-w7tkk" podStartSLOduration=2.130232492 podStartE2EDuration="4.737808601s" totalImagesPullingTime="2.607576109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:39.735914994 +0000 UTC m=+113.161128263" watchObservedRunningTime="2026-07-07 07:00:39.737808601 +0000 UTC m=+113.163021873" Jul 07 07:00:39.814603 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.814562 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64b64b8bb5-cblmj"] Jul 07 07:00:39.833934 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.833908 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64b64b8bb5-cblmj"] Jul 07 07:00:39.834243 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.834212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:39.837078 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.837051 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 07:00:39.837614 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.837553 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 07:00:39.837817 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.837793 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8vff6\"" Jul 07 07:00:39.837915 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.837793 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 07:00:39.838359 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.838339 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 07:00:39.838514 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.838494 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cofbefpochvuu\"" Jul 07 07:00:39.949220 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.949120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-audit-log\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:39.949220 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.949188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p984\" (UniqueName: \"kubernetes.io/projected/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-kube-api-access-6p984\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:39.949452 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.949233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-secret-metrics-server-client-certs\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:39.949452 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.949297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-client-ca-bundle\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:39.949452 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.949360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-secret-metrics-server-tls\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:39.949452 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.949390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-metrics-server-audit-profiles\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:39.949452 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:39.949437 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.050507 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.050458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-audit-log\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.050689 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.050539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p984\" (UniqueName: \"kubernetes.io/projected/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-kube-api-access-6p984\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.050689 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.050568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-secret-metrics-server-client-certs\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.050689 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.050621 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-client-ca-bundle\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.050689 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.050655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-secret-metrics-server-tls\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.050689 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.050678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-metrics-server-audit-profiles\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.050963 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.050911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.050963 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.050941 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-audit-log\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.051713 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.051665 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.052005 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.051962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-metrics-server-audit-profiles\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.053642 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.053615 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-secret-metrics-server-client-certs\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.055040 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.055000 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-client-ca-bundle\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.055505 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.055482 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-secret-metrics-server-tls\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.063354 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.063331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p984\" (UniqueName: \"kubernetes.io/projected/b1afd686-5b3f-4d1d-a48a-68521a3f2ce8-kube-api-access-6p984\") pod \"metrics-server-64b64b8bb5-cblmj\" (UID: \"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8\") " pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.136457 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.136423 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7"] Jul 07 07:00:40.147468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.147439 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:00:40.169203 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.169178 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d4dc49f7-srxsx"] Jul 07 07:00:40.169388 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.169316 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:40.171877 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.171856 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 07:00:40.172008 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.171989 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-r58n7\"" Jul 07 07:00:40.187743 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.187721 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7"] Jul 07 07:00:40.187845 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.187757 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d4dc49f7-srxsx"] Jul 07 07:00:40.187845 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.187811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.195530 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.195506 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 07:00:40.252760 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.252731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5kg9\" (UniqueName: \"kubernetes.io/projected/cec97655-5c6a-4fcd-a1ad-c273cc0b672e-kube-api-access-h5kg9\") pod \"monitoring-plugin-d5dcff7cf-mpns7\" (UID: \"cec97655-5c6a-4fcd-a1ad-c273cc0b672e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:40.253000 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.252979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-oauth-config\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.253186 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.253168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-service-ca\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.253403 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.253387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-console-config\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.253573 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.253557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-serving-cert\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.253773 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.253757 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22m65\" (UniqueName: \"kubernetes.io/projected/772fce0d-d3b2-48ec-8842-28505019e06f-kube-api-access-22m65\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.253934 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.253918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cec97655-5c6a-4fcd-a1ad-c273cc0b672e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-mpns7\" (UID: \"cec97655-5c6a-4fcd-a1ad-c273cc0b672e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:40.254108 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.254090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-oauth-serving-cert\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.254247 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.254234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-trusted-ca-bundle\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.343197 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.343175 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64b64b8bb5-cblmj"] Jul 07 07:00:40.345473 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:40.345444 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1afd686_5b3f_4d1d_a48a_68521a3f2ce8.slice/crio-4df5dcf00514cf9ac4189f27cc0094cf496201e4c1d02b9c466deb04377d8e52 WatchSource:0}: Error finding container 4df5dcf00514cf9ac4189f27cc0094cf496201e4c1d02b9c466deb04377d8e52: Status 404 returned error can't find the container with id 4df5dcf00514cf9ac4189f27cc0094cf496201e4c1d02b9c466deb04377d8e52 Jul 07 07:00:40.355574 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-oauth-config\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.355681 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-service-ca\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.355681 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-console-config\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.355681 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-serving-cert\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.355839 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355801 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22m65\" (UniqueName: \"kubernetes.io/projected/772fce0d-d3b2-48ec-8842-28505019e06f-kube-api-access-22m65\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.355889 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cec97655-5c6a-4fcd-a1ad-c273cc0b672e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-mpns7\" (UID: \"cec97655-5c6a-4fcd-a1ad-c273cc0b672e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:40.355889 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-oauth-serving-cert\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.355988 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-trusted-ca-bundle\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.355988 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.355940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5kg9\" (UniqueName: \"kubernetes.io/projected/cec97655-5c6a-4fcd-a1ad-c273cc0b672e-kube-api-access-h5kg9\") pod \"monitoring-plugin-d5dcff7cf-mpns7\" (UID: \"cec97655-5c6a-4fcd-a1ad-c273cc0b672e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:40.356468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.356442 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-console-config\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.356571 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.356483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-service-ca\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.356753 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.356734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-oauth-serving-cert\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.357122 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.357099 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-trusted-ca-bundle\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.358082 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.358051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-serving-cert\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.358181 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.358136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-oauth-config\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.358323 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.358303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cec97655-5c6a-4fcd-a1ad-c273cc0b672e-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-mpns7\" (UID: \"cec97655-5c6a-4fcd-a1ad-c273cc0b672e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:40.364655 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.364635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22m65\" (UniqueName: \"kubernetes.io/projected/772fce0d-d3b2-48ec-8842-28505019e06f-kube-api-access-22m65\") pod \"console-d4dc49f7-srxsx\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.364812 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.364793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5kg9\" (UniqueName: \"kubernetes.io/projected/cec97655-5c6a-4fcd-a1ad-c273cc0b672e-kube-api-access-h5kg9\") pod \"monitoring-plugin-d5dcff7cf-mpns7\" (UID: \"cec97655-5c6a-4fcd-a1ad-c273cc0b672e\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:40.480235 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.480168 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:40.496526 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.496501 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:40.699600 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.699550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" event={"ID":"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8","Type":"ContainerStarted","Data":"4df5dcf00514cf9ac4189f27cc0094cf496201e4c1d02b9c466deb04377d8e52"} Jul 07 07:00:40.702057 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.702023 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckv7d" event={"ID":"0c391394-aa02-488e-9267-410b75525ade","Type":"ContainerStarted","Data":"bd055b47cc2979d38f7a653d5d8e7b13df6c36a402ab493fc282b40941828550"} Jul 07 07:00:40.702211 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:40.702079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ckv7d" event={"ID":"0c391394-aa02-488e-9267-410b75525ade","Type":"ContainerStarted","Data":"c626f60584d31ee514a4bedb40938fee7443d8a5c76412124b9abafae146a67c"} Jul 07 07:00:41.250403 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.250345 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ckv7d" podStartSLOduration=4.151920772 podStartE2EDuration="6.250323478s" totalImagesPullingTime="1.958376364s" totalInitContainerRuntime="140.026342ms" isStatefulPod=true podCreationTimestamp="2026-07-07 07:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:40.731497801 +0000 UTC m=+114.156711064" watchObservedRunningTime="2026-07-07 07:00:41.250323478 +0000 UTC m=+114.675536748" Jul 07 07:00:41.251538 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.251519 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d4dc49f7-srxsx"] Jul 07 07:00:41.275019 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.274993 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7"] Jul 07 07:00:41.286369 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:41.286347 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772fce0d_d3b2_48ec_8842_28505019e06f.slice/crio-746463b00b7a60cd600d8c7325e35239aa7de886602a9311dc1c7cf8e5eb2550 WatchSource:0}: Error finding container 746463b00b7a60cd600d8c7325e35239aa7de886602a9311dc1c7cf8e5eb2550: Status 404 returned error can't find the container with id 746463b00b7a60cd600d8c7325e35239aa7de886602a9311dc1c7cf8e5eb2550 Jul 07 07:00:41.424783 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:41.424713 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec97655_5c6a_4fcd_a1ad_c273cc0b672e.slice/crio-c5c3d6789f30aae849dee0ae4b07e39abc6d3e187d435aa630b8d1a80af89d2b WatchSource:0}: Error finding container c5c3d6789f30aae849dee0ae4b07e39abc6d3e187d435aa630b8d1a80af89d2b: Status 404 returned error can't find the container with id c5c3d6789f30aae849dee0ae4b07e39abc6d3e187d435aa630b8d1a80af89d2b Jul 07 07:00:41.706328 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.706298 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" event={"ID":"cec97655-5c6a-4fcd-a1ad-c273cc0b672e","Type":"ContainerStarted","Data":"c5c3d6789f30aae849dee0ae4b07e39abc6d3e187d435aa630b8d1a80af89d2b"} Jul 07 07:00:41.707805 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.707782 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d4dc49f7-srxsx" event={"ID":"772fce0d-d3b2-48ec-8842-28505019e06f","Type":"ContainerStarted","Data":"866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801"} Jul 07 07:00:41.707913 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.707827 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d4dc49f7-srxsx" event={"ID":"772fce0d-d3b2-48ec-8842-28505019e06f","Type":"ContainerStarted","Data":"746463b00b7a60cd600d8c7325e35239aa7de886602a9311dc1c7cf8e5eb2550"} Jul 07 07:00:41.709282 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.709257 2565 generic.go:356] "Generic (PLEG): container finished" podID="2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d" containerID="c3b3d80c2b45c589c575737c2bf502f9044c3843d362861c6960f4365e581ba4" exitCode=0 Jul 07 07:00:41.709390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.709351 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d","Type":"ContainerDied","Data":"c3b3d80c2b45c589c575737c2bf502f9044c3843d362861c6960f4365e581ba4"} Jul 07 07:00:41.710886 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.710862 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" event={"ID":"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5","Type":"ContainerStarted","Data":"e0246b52351a3bb7546429eb84723b5943292d7802cf994e919fd853dae07081"} Jul 07 07:00:41.731635 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:41.731597 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d4dc49f7-srxsx" podStartSLOduration=1.731569812 podStartE2EDuration="1.731569812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:41.73005802 +0000 UTC m=+115.155271310" watchObservedRunningTime="2026-07-07 07:00:41.731569812 +0000 UTC m=+115.156783082" Jul 07 07:00:42.637149 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:42.637118 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-drl6g" Jul 07 07:00:42.719261 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:42.719202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" event={"ID":"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5","Type":"ContainerStarted","Data":"2de8c4d7ac552e27df4269e4a8f18472a82bfceeaf3efb719dd1978c5e064291"} Jul 07 07:00:42.719680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:42.719293 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" event={"ID":"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5","Type":"ContainerStarted","Data":"e76cbd95a4260f33d7073ca27c5f5d63e612e05c96a94c8496815decc273a674"} Jul 07 07:00:45.734770 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.734675 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d","Type":"ContainerStarted","Data":"4fcb671e6a50d37f41f8718039b4ee0fc4bda2217ce633176b9bfa6da55b9b2f"} Jul 07 07:00:45.734770 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.734766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d","Type":"ContainerStarted","Data":"f1b9c6f9a806800cd37f2b973f96bfbcd11c338ebe35d2f23425d5698a5687f4"} Jul 07 07:00:45.735300 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.734814 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d","Type":"ContainerStarted","Data":"1cc2fa3aaca1c73ea85d7de1f7b96a77d3d29db50053318f96c359b181bc122f"} Jul 07 07:00:45.735300 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.734854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d","Type":"ContainerStarted","Data":"265a2d8cf605b819097e20851a5574f5f5656b3803f55a1cd9aab67d58ee8ed7"} Jul 07 07:00:45.735300 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.734893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d","Type":"ContainerStarted","Data":"1c13b813c145e18e358189221a0572d01984576cf37514d0ca263145dfb34a7d"} Jul 07 07:00:45.735300 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.734933 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d","Type":"ContainerStarted","Data":"36182c894ab69bfeed3839b6d767d6ed1277afae6c2313d6ef3dafb55558622d"} Jul 07 07:00:45.740942 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.740905 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" event={"ID":"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5","Type":"ContainerStarted","Data":"10820436771d13ed51dc1f240b30d7a3706310737686896d4231bafa11cad06c"} Jul 07 07:00:45.741098 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.740997 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" event={"ID":"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5","Type":"ContainerStarted","Data":"b75936c3e16f25253a1a8cf5124643093d497608f2da1047f064261d58735b77"} Jul 07 07:00:45.741098 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.741047 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" event={"ID":"fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5","Type":"ContainerStarted","Data":"87eb95c9227338a2f79ad3f9f4e84dea3c64e65497d39fdc126b3a25db5a1aad"} Jul 07 07:00:45.741240 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.741107 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:45.742686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.742649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" event={"ID":"b1afd686-5b3f-4d1d-a48a-68521a3f2ce8","Type":"ContainerStarted","Data":"0c0974d21a0b2f6342e6ffd54af30549b19086a452fbbcc1473bf0b0ac847619"} Jul 07 07:00:45.744026 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.744004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" event={"ID":"cec97655-5c6a-4fcd-a1ad-c273cc0b672e","Type":"ContainerStarted","Data":"f6eebbb5418e84b122a98740254f7bafc96839944f697ffce3477e6b7a6e9384"} Jul 07 07:00:45.744122 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.744053 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:45.750411 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.750392 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" Jul 07 07:00:45.765762 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.765717 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.036945169 podStartE2EDuration="9.765701838s" totalImagesPullingTime="5.710103997s" totalInitContainerRuntime="18.652672ms" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:45.764213631 +0000 UTC m=+119.189426900" watchObservedRunningTime="2026-07-07 07:00:45.765701838 +0000 UTC m=+119.190915106" Jul 07 07:00:45.788399 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.788353 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" podStartSLOduration=2.846486712 podStartE2EDuration="8.788337524s" totalImagesPullingTime="5.941850812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:45.786560419 +0000 UTC m=+119.211773689" watchObservedRunningTime="2026-07-07 07:00:45.788337524 +0000 UTC m=+119.213550792" Jul 07 07:00:45.807182 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.807132 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" podStartSLOduration=2.286532983 podStartE2EDuration="6.807114309s" totalImagesPullingTime="4.520581326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:45.805313201 +0000 UTC m=+119.230526469" watchObservedRunningTime="2026-07-07 07:00:45.807114309 +0000 UTC m=+119.232327579" Jul 07 07:00:45.822765 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:45.822705 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-mpns7" podStartSLOduration=2.359325563 podStartE2EDuration="5.822681819s" totalImagesPullingTime="3.463356256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:45.822134346 +0000 UTC m=+119.247347615" watchObservedRunningTime="2026-07-07 07:00:45.822681819 +0000 UTC m=+119.247895091" Jul 07 07:00:46.753395 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:46.753364 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-9447d957d-rht4c" Jul 07 07:00:50.497168 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:50.497133 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:50.497621 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:50.497182 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:50.501974 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:50.501951 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:50.772884 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:50.772806 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:00:57.006005 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:57.005960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 07:00:57.008296 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:57.008269 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3e6926b-be32-403e-a606-04a5a6d3369b-metrics-certs\") pod \"network-metrics-daemon-6tjjb\" (UID: \"e3e6926b-be32-403e-a606-04a5a6d3369b\") " pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 07:00:57.244791 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:57.244759 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-59nzl\"" Jul 07 07:00:57.249458 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:57.249442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tjjb" Jul 07 07:00:57.412529 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:57.412508 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tjjb"] Jul 07 07:00:57.414738 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:00:57.414714 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e6926b_be32_403e_a606_04a5a6d3369b.slice/crio-83d34e029421e8e3a2a670fb4864fdba51db1854d3c4949cce262b5dfbe9d0e2 WatchSource:0}: Error finding container 83d34e029421e8e3a2a670fb4864fdba51db1854d3c4949cce262b5dfbe9d0e2: Status 404 returned error can't find the container with id 83d34e029421e8e3a2a670fb4864fdba51db1854d3c4949cce262b5dfbe9d0e2 Jul 07 07:00:57.796410 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:57.796373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tjjb" event={"ID":"e3e6926b-be32-403e-a606-04a5a6d3369b","Type":"ContainerStarted","Data":"83d34e029421e8e3a2a670fb4864fdba51db1854d3c4949cce262b5dfbe9d0e2"} Jul 07 07:00:59.597183 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.597142 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-669f8fdcbd-bw7k8" podUID="da651968-da32-4079-b22b-2d964e9f569a" containerName="console" containerID="cri-o://11b46943cb4a69cd1781da6e09c44ddd946401df9f009e4c75b8bdfc6ed1cbed" gracePeriod=15 Jul 07 07:00:59.805923 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.805889 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tjjb" event={"ID":"e3e6926b-be32-403e-a606-04a5a6d3369b","Type":"ContainerStarted","Data":"fe48b60bf3ab9d43bab55a99c6eac33201c5d5cbe39e5bcd6b513609095f824c"} Jul 07 07:00:59.806081 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.805949 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tjjb" event={"ID":"e3e6926b-be32-403e-a606-04a5a6d3369b","Type":"ContainerStarted","Data":"f7cc4e08a168abc9e8091d63792ec032249d01f31f1f5cd9bb520f96bab154a8"} Jul 07 07:00:59.807389 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.807366 2565 generic.go:356] "Generic (PLEG): container finished" podID="da651968-da32-4079-b22b-2d964e9f569a" containerID="11b46943cb4a69cd1781da6e09c44ddd946401df9f009e4c75b8bdfc6ed1cbed" exitCode=0 Jul 07 07:00:59.807482 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.807416 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669f8fdcbd-bw7k8" event={"ID":"da651968-da32-4079-b22b-2d964e9f569a","Type":"ContainerDied","Data":"11b46943cb4a69cd1781da6e09c44ddd946401df9f009e4c75b8bdfc6ed1cbed"} Jul 07 07:00:59.826107 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.826055 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6tjjb" podStartSLOduration=131.222786789 podStartE2EDuration="2m12.82603544s" totalImagesPullingTime="1.603248651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 06:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:00:59.825811517 +0000 UTC m=+133.251024785" watchObservedRunningTime="2026-07-07 07:00:59.82603544 +0000 UTC m=+133.251248710" Jul 07 07:00:59.869855 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.869834 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:00:59.931895 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.931868 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-serving-cert\") pod \"da651968-da32-4079-b22b-2d964e9f569a\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " Jul 07 07:00:59.932059 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.931924 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-console-config\") pod \"da651968-da32-4079-b22b-2d964e9f569a\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " Jul 07 07:00:59.932059 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.931956 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-oauth-config\") pod \"da651968-da32-4079-b22b-2d964e9f569a\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " Jul 07 07:00:59.932059 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.932029 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-oauth-serving-cert\") pod \"da651968-da32-4079-b22b-2d964e9f569a\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " Jul 07 07:00:59.932169 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.932079 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-service-ca\") pod \"da651968-da32-4079-b22b-2d964e9f569a\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " Jul 07 07:00:59.932169 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.932107 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7dhc\" (UniqueName: \"kubernetes.io/projected/da651968-da32-4079-b22b-2d964e9f569a-kube-api-access-j7dhc\") pod \"da651968-da32-4079-b22b-2d964e9f569a\" (UID: \"da651968-da32-4079-b22b-2d964e9f569a\") " Jul 07 07:00:59.932402 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.932368 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-console-config" (OuterVolumeSpecName: "console-config") pod "da651968-da32-4079-b22b-2d964e9f569a" (UID: "da651968-da32-4079-b22b-2d964e9f569a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:00:59.932515 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.932428 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-service-ca" (OuterVolumeSpecName: "service-ca") pod "da651968-da32-4079-b22b-2d964e9f569a" (UID: "da651968-da32-4079-b22b-2d964e9f569a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:00:59.932515 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.932456 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da651968-da32-4079-b22b-2d964e9f569a" (UID: "da651968-da32-4079-b22b-2d964e9f569a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:00:59.934222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.934198 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da651968-da32-4079-b22b-2d964e9f569a" (UID: "da651968-da32-4079-b22b-2d964e9f569a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:00:59.934304 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.934231 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da651968-da32-4079-b22b-2d964e9f569a" (UID: "da651968-da32-4079-b22b-2d964e9f569a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:00:59.934304 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:00:59.934262 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da651968-da32-4079-b22b-2d964e9f569a-kube-api-access-j7dhc" (OuterVolumeSpecName: "kube-api-access-j7dhc") pod "da651968-da32-4079-b22b-2d964e9f569a" (UID: "da651968-da32-4079-b22b-2d964e9f569a"). InnerVolumeSpecName "kube-api-access-j7dhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:01:00.033077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.033040 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-service-ca\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:01:00.033077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.033072 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7dhc\" (UniqueName: \"kubernetes.io/projected/da651968-da32-4079-b22b-2d964e9f569a-kube-api-access-j7dhc\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:01:00.033077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.033081 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-serving-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:01:00.033077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.033089 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-console-config\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:01:00.033325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.033098 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da651968-da32-4079-b22b-2d964e9f569a-console-oauth-config\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:01:00.033325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.033106 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da651968-da32-4079-b22b-2d964e9f569a-oauth-serving-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:01:00.148299 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.148217 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:01:00.148433 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.148290 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:01:00.813358 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.813332 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669f8fdcbd-bw7k8" Jul 07 07:01:00.813767 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.813377 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669f8fdcbd-bw7k8" event={"ID":"da651968-da32-4079-b22b-2d964e9f569a","Type":"ContainerDied","Data":"37fac901665b11992f419f700116f690b61d6c36b4dafded9bb3d07e1408e466"} Jul 07 07:01:00.813767 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.813439 2565 scope.go:117] "RemoveContainer" containerID="11b46943cb4a69cd1781da6e09c44ddd946401df9f009e4c75b8bdfc6ed1cbed" Jul 07 07:01:00.836194 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.836170 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-669f8fdcbd-bw7k8"] Jul 07 07:01:00.840330 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:00.840311 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-669f8fdcbd-bw7k8"] Jul 07 07:01:01.133424 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:01.133393 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da651968-da32-4079-b22b-2d964e9f569a" path="/var/lib/kubelet/pods/da651968-da32-4079-b22b-2d964e9f569a/volumes" Jul 07 07:01:20.154821 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:20.154793 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:01:20.159968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:20.159944 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64b64b8bb5-cblmj" Jul 07 07:01:59.741108 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.741077 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c959b9866-qwd9x"] Jul 07 07:01:59.741559 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.741425 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da651968-da32-4079-b22b-2d964e9f569a" containerName="console" Jul 07 07:01:59.741559 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.741436 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da651968-da32-4079-b22b-2d964e9f569a" containerName="console" Jul 07 07:01:59.741559 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.741492 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da651968-da32-4079-b22b-2d964e9f569a" containerName="console" Jul 07 07:01:59.746065 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.746043 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.748713 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.748696 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-n92dv\"" Jul 07 07:01:59.748828 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.748702 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 07:01:59.749051 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.749037 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 07:01:59.749393 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.749368 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 07:01:59.749479 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.749462 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 07:01:59.749652 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.749635 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 07:01:59.758016 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.757992 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 07:01:59.760195 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.760172 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c959b9866-qwd9x"] Jul 07 07:01:59.839225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.839197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-telemeter-client-tls\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.839225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.839228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-federate-client-tls\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.839468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.839253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-serving-certs-ca-bundle\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.839468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.839350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-metrics-client-ca\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.839468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.839381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.839468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.839408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6v6p\" (UniqueName: \"kubernetes.io/projected/771cb096-2943-41a5-806d-1688c35fa071-kube-api-access-n6v6p\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.839468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.839433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.839468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.839463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-secret-telemeter-client\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.939971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.939934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-telemeter-client-tls\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.939971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.939977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-federate-client-tls\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.940231 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.940010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-serving-certs-ca-bundle\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.940231 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.940037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-metrics-client-ca\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.940231 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.940183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.940231 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.940224 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6v6p\" (UniqueName: \"kubernetes.io/projected/771cb096-2943-41a5-806d-1688c35fa071-kube-api-access-n6v6p\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.940437 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.940252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.940437 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.940286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-secret-telemeter-client\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.940879 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.940852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-metrics-client-ca\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.941126 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.941104 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-serving-certs-ca-bundle\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.941208 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.941107 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/771cb096-2943-41a5-806d-1688c35fa071-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.942668 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.942636 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-secret-telemeter-client\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.942772 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.942746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-telemeter-client-tls\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.942859 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.942841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.942925 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.942909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/771cb096-2943-41a5-806d-1688c35fa071-federate-client-tls\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:01:59.950186 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:01:59.950166 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6v6p\" (UniqueName: \"kubernetes.io/projected/771cb096-2943-41a5-806d-1688c35fa071-kube-api-access-n6v6p\") pod \"telemeter-client-5c959b9866-qwd9x\" (UID: \"771cb096-2943-41a5-806d-1688c35fa071\") " pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:02:00.054934 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:00.054844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" Jul 07 07:02:00.196665 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:00.196634 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c959b9866-qwd9x"] Jul 07 07:02:00.200908 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:02:00.200873 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771cb096_2943_41a5_806d_1688c35fa071.slice/crio-fff5c403f65c1ce2c9587f8f6dd857ff9cb6ee11a88e659c51ddc71e88ab82ad WatchSource:0}: Error finding container fff5c403f65c1ce2c9587f8f6dd857ff9cb6ee11a88e659c51ddc71e88ab82ad: Status 404 returned error can't find the container with id fff5c403f65c1ce2c9587f8f6dd857ff9cb6ee11a88e659c51ddc71e88ab82ad Jul 07 07:02:01.055489 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:01.055457 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" event={"ID":"771cb096-2943-41a5-806d-1688c35fa071","Type":"ContainerStarted","Data":"fff5c403f65c1ce2c9587f8f6dd857ff9cb6ee11a88e659c51ddc71e88ab82ad"} Jul 07 07:02:03.069762 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.069727 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" event={"ID":"771cb096-2943-41a5-806d-1688c35fa071","Type":"ContainerStarted","Data":"4be8c8e5bda1c016869c87ab7c3ae30c5691f9b472149447656c2d757aa543d4"} Jul 07 07:02:03.070182 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.069820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" event={"ID":"771cb096-2943-41a5-806d-1688c35fa071","Type":"ContainerStarted","Data":"24203054538ea28c48e8acb1a70c70f6c08174d6b267209fc12651875e2f1815"} Jul 07 07:02:03.070182 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.069853 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" event={"ID":"771cb096-2943-41a5-806d-1688c35fa071","Type":"ContainerStarted","Data":"c852955406a8eedd5c15965bf164e5f86260bac6a33748874959ff96770a4251"} Jul 07 07:02:03.095532 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.095481 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c959b9866-qwd9x" podStartSLOduration=2.043091457 podStartE2EDuration="4.095460785s" totalImagesPullingTime="2.052369328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:02:03.094746747 +0000 UTC m=+196.519960017" watchObservedRunningTime="2026-07-07 07:02:03.095460785 +0000 UTC m=+196.520674055" Jul 07 07:02:03.756161 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.756122 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d5c5fcf5-rcxqk"] Jul 07 07:02:03.759638 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.759607 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.777136 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.777107 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d5c5fcf5-rcxqk"] Jul 07 07:02:03.874711 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.874675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-oauth-serving-cert\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.874893 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.874742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-serving-cert\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.874893 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.874768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-config\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.874893 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.874794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-service-ca\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.874893 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.874817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-trusted-ca-bundle\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.874893 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.874876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cldh9\" (UniqueName: \"kubernetes.io/projected/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-kube-api-access-cldh9\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.875057 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.874928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-oauth-config\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976036 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976004 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-serving-cert\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976036 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-config\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976223 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-service-ca\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976223 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976083 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-trusted-ca-bundle\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976223 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cldh9\" (UniqueName: \"kubernetes.io/projected/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-kube-api-access-cldh9\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-oauth-config\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976353 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976319 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-oauth-serving-cert\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-config\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.976984 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.976910 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-service-ca\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.977036 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.977020 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-trusted-ca-bundle\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.977036 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.977026 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-oauth-serving-cert\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.978658 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.978638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-serving-cert\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.978744 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.978723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-oauth-config\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:03.986397 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:03.986375 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cldh9\" (UniqueName: \"kubernetes.io/projected/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-kube-api-access-cldh9\") pod \"console-86d5c5fcf5-rcxqk\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:04.068832 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:04.068747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:04.205630 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:04.205610 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d5c5fcf5-rcxqk"] Jul 07 07:02:04.207576 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:02:04.207554 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bbfb43_0bbd_4ae9_b6f6_6971858251a9.slice/crio-d750258cc9fd783771edb78bca181b5dbb0af9223d883fe60a7488be7388bdc5 WatchSource:0}: Error finding container d750258cc9fd783771edb78bca181b5dbb0af9223d883fe60a7488be7388bdc5: Status 404 returned error can't find the container with id d750258cc9fd783771edb78bca181b5dbb0af9223d883fe60a7488be7388bdc5 Jul 07 07:02:05.080229 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:05.080198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d5c5fcf5-rcxqk" event={"ID":"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9","Type":"ContainerStarted","Data":"199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf"} Jul 07 07:02:05.080472 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:05.080245 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d5c5fcf5-rcxqk" event={"ID":"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9","Type":"ContainerStarted","Data":"d750258cc9fd783771edb78bca181b5dbb0af9223d883fe60a7488be7388bdc5"} Jul 07 07:02:05.106052 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:05.105999 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d5c5fcf5-rcxqk" podStartSLOduration=2.105984492 podStartE2EDuration="2.105984492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:02:05.104708006 +0000 UTC m=+198.529921275" watchObservedRunningTime="2026-07-07 07:02:05.105984492 +0000 UTC m=+198.531197761" Jul 07 07:02:14.069603 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.069549 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:14.069985 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.069626 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:14.074315 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.074297 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:14.119619 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.119570 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:14.170434 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.170404 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d4dc49f7-srxsx"] Jul 07 07:02:14.272025 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.271995 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f87855f6-mj8f5"] Jul 07 07:02:14.274257 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.274237 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.289619 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.289574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f87855f6-mj8f5"] Jul 07 07:02:14.367907 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.367872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-trusted-ca-bundle\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.368078 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.367934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-oauth-config\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.368078 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.367954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-oauth-serving-cert\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.368078 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.367971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-config\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.368078 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.367997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-service-ca\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.368078 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.368068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-serving-cert\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.368269 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.368106 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjnn\" (UniqueName: \"kubernetes.io/projected/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-kube-api-access-pjjnn\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469062 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-service-ca\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469201 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469069 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-serving-cert\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469201 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjjnn\" (UniqueName: \"kubernetes.io/projected/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-kube-api-access-pjjnn\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469201 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-trusted-ca-bundle\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469201 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-oauth-config\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469201 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-oauth-serving-cert\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469201 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-config\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469887 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-service-ca\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.469972 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-config\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.470037 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.469937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-oauth-serving-cert\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.470212 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.470191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-trusted-ca-bundle\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.471629 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.471578 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-oauth-config\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.471720 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.471660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-serving-cert\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.478655 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.478633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjjnn\" (UniqueName: \"kubernetes.io/projected/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-kube-api-access-pjjnn\") pod \"console-54f87855f6-mj8f5\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.584224 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.584193 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:14.731757 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:14.731729 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f87855f6-mj8f5"] Jul 07 07:02:14.733615 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:02:14.733571 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe0c864_6c5e_4d80_893b_f89f9592cfd0.slice/crio-98bdc3d956d217de973043325887f546aede5278e06ad809068b70193a131c7a WatchSource:0}: Error finding container 98bdc3d956d217de973043325887f546aede5278e06ad809068b70193a131c7a: Status 404 returned error can't find the container with id 98bdc3d956d217de973043325887f546aede5278e06ad809068b70193a131c7a Jul 07 07:02:15.121647 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:15.121608 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f87855f6-mj8f5" event={"ID":"3fe0c864-6c5e-4d80-893b-f89f9592cfd0","Type":"ContainerStarted","Data":"0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185"} Jul 07 07:02:15.122068 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:15.121664 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f87855f6-mj8f5" event={"ID":"3fe0c864-6c5e-4d80-893b-f89f9592cfd0","Type":"ContainerStarted","Data":"98bdc3d956d217de973043325887f546aede5278e06ad809068b70193a131c7a"} Jul 07 07:02:15.148761 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:15.148710 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f87855f6-mj8f5" podStartSLOduration=1.148694026 podStartE2EDuration="1.148694026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:02:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:02:15.146083697 +0000 UTC m=+208.571296959" watchObservedRunningTime="2026-07-07 07:02:15.148694026 +0000 UTC m=+208.573907295" Jul 07 07:02:24.584812 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:24.584776 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:24.585268 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:24.584827 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:24.589463 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:24.589437 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:25.171346 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:25.171316 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:02:25.225241 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:25.225204 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d5c5fcf5-rcxqk"] Jul 07 07:02:39.197141 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.197100 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d4dc49f7-srxsx" podUID="772fce0d-d3b2-48ec-8842-28505019e06f" containerName="console" containerID="cri-o://866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801" gracePeriod=15 Jul 07 07:02:39.440011 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.439984 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:02:39.582448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582422 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-trusted-ca-bundle\") pod \"772fce0d-d3b2-48ec-8842-28505019e06f\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " Jul 07 07:02:39.582625 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582482 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-service-ca\") pod \"772fce0d-d3b2-48ec-8842-28505019e06f\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " Jul 07 07:02:39.582625 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582499 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-console-config\") pod \"772fce0d-d3b2-48ec-8842-28505019e06f\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " Jul 07 07:02:39.582625 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582518 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-serving-cert\") pod \"772fce0d-d3b2-48ec-8842-28505019e06f\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " Jul 07 07:02:39.582625 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582544 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22m65\" (UniqueName: \"kubernetes.io/projected/772fce0d-d3b2-48ec-8842-28505019e06f-kube-api-access-22m65\") pod \"772fce0d-d3b2-48ec-8842-28505019e06f\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " Jul 07 07:02:39.582625 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582571 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-oauth-serving-cert\") pod \"772fce0d-d3b2-48ec-8842-28505019e06f\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " Jul 07 07:02:39.582873 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582629 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-oauth-config\") pod \"772fce0d-d3b2-48ec-8842-28505019e06f\" (UID: \"772fce0d-d3b2-48ec-8842-28505019e06f\") " Jul 07 07:02:39.582924 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582866 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "772fce0d-d3b2-48ec-8842-28505019e06f" (UID: "772fce0d-d3b2-48ec-8842-28505019e06f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:02:39.583023 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.582992 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-service-ca" (OuterVolumeSpecName: "service-ca") pod "772fce0d-d3b2-48ec-8842-28505019e06f" (UID: "772fce0d-d3b2-48ec-8842-28505019e06f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:02:39.583106 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.583082 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "772fce0d-d3b2-48ec-8842-28505019e06f" (UID: "772fce0d-d3b2-48ec-8842-28505019e06f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:02:39.583152 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.583090 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-console-config" (OuterVolumeSpecName: "console-config") pod "772fce0d-d3b2-48ec-8842-28505019e06f" (UID: "772fce0d-d3b2-48ec-8842-28505019e06f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:02:39.584726 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.584698 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "772fce0d-d3b2-48ec-8842-28505019e06f" (UID: "772fce0d-d3b2-48ec-8842-28505019e06f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:02:39.584830 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.584745 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/772fce0d-d3b2-48ec-8842-28505019e06f-kube-api-access-22m65" (OuterVolumeSpecName: "kube-api-access-22m65") pod "772fce0d-d3b2-48ec-8842-28505019e06f" (UID: "772fce0d-d3b2-48ec-8842-28505019e06f"). InnerVolumeSpecName "kube-api-access-22m65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:02:39.584830 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.584749 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "772fce0d-d3b2-48ec-8842-28505019e06f" (UID: "772fce0d-d3b2-48ec-8842-28505019e06f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:02:39.683446 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.683416 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-trusted-ca-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:39.683446 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.683442 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-service-ca\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:39.683446 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.683452 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-console-config\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:39.683669 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.683459 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-serving-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:39.683669 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.683468 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22m65\" (UniqueName: \"kubernetes.io/projected/772fce0d-d3b2-48ec-8842-28505019e06f-kube-api-access-22m65\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:39.683669 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.683476 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/772fce0d-d3b2-48ec-8842-28505019e06f-oauth-serving-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:39.683669 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:39.683486 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/772fce0d-d3b2-48ec-8842-28505019e06f-console-oauth-config\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:40.241603 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.241555 2565 generic.go:356] "Generic (PLEG): container finished" podID="772fce0d-d3b2-48ec-8842-28505019e06f" containerID="866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801" exitCode=0 Jul 07 07:02:40.242140 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.241619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d4dc49f7-srxsx" event={"ID":"772fce0d-d3b2-48ec-8842-28505019e06f","Type":"ContainerDied","Data":"866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801"} Jul 07 07:02:40.242140 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.241698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d4dc49f7-srxsx" event={"ID":"772fce0d-d3b2-48ec-8842-28505019e06f","Type":"ContainerDied","Data":"746463b00b7a60cd600d8c7325e35239aa7de886602a9311dc1c7cf8e5eb2550"} Jul 07 07:02:40.242140 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.241631 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d4dc49f7-srxsx" Jul 07 07:02:40.242140 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.241719 2565 scope.go:117] "RemoveContainer" containerID="866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801" Jul 07 07:02:40.250627 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.250610 2565 scope.go:117] "RemoveContainer" containerID="866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801" Jul 07 07:02:40.250873 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:02:40.250857 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801\": container with ID starting with 866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801 not found: ID does not exist" containerID="866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801" Jul 07 07:02:40.250921 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.250881 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801"} err="failed to get container status \"866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801\": rpc error: code = NotFound desc = could not find container \"866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801\": container with ID starting with 866c9eb0afaec0b586e10c725d614540723345f6509915123bb37d33cf338801 not found: ID does not exist" Jul 07 07:02:40.264114 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.264090 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d4dc49f7-srxsx"] Jul 07 07:02:40.269619 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:40.269600 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d4dc49f7-srxsx"] Jul 07 07:02:41.134832 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:41.134801 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="772fce0d-d3b2-48ec-8842-28505019e06f" path="/var/lib/kubelet/pods/772fce0d-d3b2-48ec-8842-28505019e06f/volumes" Jul 07 07:02:50.250334 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.250273 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86d5c5fcf5-rcxqk" podUID="e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" containerName="console" containerID="cri-o://199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf" gracePeriod=15 Jul 07 07:02:50.493903 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.493871 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:50.574320 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574294 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-serving-cert\") pod \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " Jul 07 07:02:50.574489 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574335 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-oauth-config\") pod \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " Jul 07 07:02:50.574489 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574361 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-service-ca\") pod \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " Jul 07 07:02:50.574489 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574383 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-oauth-serving-cert\") pod \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " Jul 07 07:02:50.574489 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574412 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cldh9\" (UniqueName: \"kubernetes.io/projected/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-kube-api-access-cldh9\") pod \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " Jul 07 07:02:50.574489 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574438 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-trusted-ca-bundle\") pod \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " Jul 07 07:02:50.574779 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574539 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-config\") pod \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\" (UID: \"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9\") " Jul 07 07:02:50.574869 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574844 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" (UID: "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:02:50.574927 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574868 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" (UID: "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:02:50.574993 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.574967 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" (UID: "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:02:50.575082 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.575046 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-config" (OuterVolumeSpecName: "console-config") pod "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" (UID: "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:02:50.576468 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.576444 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" (UID: "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:02:50.576855 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.576835 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" (UID: "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:02:50.576947 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.576924 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-kube-api-access-cldh9" (OuterVolumeSpecName: "kube-api-access-cldh9") pod "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" (UID: "e0bbfb43-0bbd-4ae9-b6f6-6971858251a9"). InnerVolumeSpecName "kube-api-access-cldh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:02:50.675654 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.675621 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-service-ca\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:50.675654 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.675650 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-oauth-serving-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:50.675654 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.675659 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cldh9\" (UniqueName: \"kubernetes.io/projected/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-kube-api-access-cldh9\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:50.675890 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.675669 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-trusted-ca-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:50.675890 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.675677 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-config\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:50.675890 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.675686 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-serving-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:50.675890 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:50.675694 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9-console-oauth-config\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:02:51.290255 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.290223 2565 generic.go:356] "Generic (PLEG): container finished" podID="e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" containerID="199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf" exitCode=0 Jul 07 07:02:51.290686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.290268 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d5c5fcf5-rcxqk" Jul 07 07:02:51.290686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.290279 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d5c5fcf5-rcxqk" event={"ID":"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9","Type":"ContainerDied","Data":"199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf"} Jul 07 07:02:51.290686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.290316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d5c5fcf5-rcxqk" event={"ID":"e0bbfb43-0bbd-4ae9-b6f6-6971858251a9","Type":"ContainerDied","Data":"d750258cc9fd783771edb78bca181b5dbb0af9223d883fe60a7488be7388bdc5"} Jul 07 07:02:51.290686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.290337 2565 scope.go:117] "RemoveContainer" containerID="199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf" Jul 07 07:02:51.298444 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.298425 2565 scope.go:117] "RemoveContainer" containerID="199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf" Jul 07 07:02:51.298750 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:02:51.298732 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf\": container with ID starting with 199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf not found: ID does not exist" containerID="199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf" Jul 07 07:02:51.298805 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.298758 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf"} err="failed to get container status \"199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf\": rpc error: code = NotFound desc = could not find container \"199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf\": container with ID starting with 199b34b9696bba41064cceb09221dc2aeae3014e962f407f2ad2fbf59ef07abf not found: ID does not exist" Jul 07 07:02:51.309033 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.309011 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d5c5fcf5-rcxqk"] Jul 07 07:02:51.317284 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:51.317260 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d5c5fcf5-rcxqk"] Jul 07 07:02:53.133313 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:02:53.133278 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" path="/var/lib/kubelet/pods/e0bbfb43-0bbd-4ae9-b6f6-6971858251a9/volumes" Jul 07 07:03:38.167192 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.167150 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr"] Jul 07 07:03:38.167763 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.167672 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="772fce0d-d3b2-48ec-8842-28505019e06f" containerName="console" Jul 07 07:03:38.167763 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.167691 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="772fce0d-d3b2-48ec-8842-28505019e06f" containerName="console" Jul 07 07:03:38.167763 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.167712 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" containerName="console" Jul 07 07:03:38.167763 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.167721 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" containerName="console" Jul 07 07:03:38.167982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.167801 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0bbfb43-0bbd-4ae9-b6f6-6971858251a9" containerName="console" Jul 07 07:03:38.167982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.167814 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="772fce0d-d3b2-48ec-8842-28505019e06f" containerName="console" Jul 07 07:03:38.171074 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.171053 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.173597 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.173565 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 07:03:38.173712 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.173654 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 07:03:38.174292 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.174277 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dtm7q\"" Jul 07 07:03:38.179894 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.179867 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr"] Jul 07 07:03:38.263931 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.263894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.264102 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.264002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtv92\" (UniqueName: \"kubernetes.io/projected/69bee49b-e02e-4579-87de-e5e11a3894d0-kube-api-access-jtv92\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.264102 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.264029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.365185 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.365150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtv92\" (UniqueName: \"kubernetes.io/projected/69bee49b-e02e-4579-87de-e5e11a3894d0-kube-api-access-jtv92\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.365322 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.365205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.365322 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.365261 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.365632 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.365610 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.365730 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.365657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.375440 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.375406 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtv92\" (UniqueName: \"kubernetes.io/projected/69bee49b-e02e-4579-87de-e5e11a3894d0-kube-api-access-jtv92\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.480743 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.480654 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:38.617640 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:38.617614 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr"] Jul 07 07:03:38.619951 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:03:38.619924 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69bee49b_e02e_4579_87de_e5e11a3894d0.slice/crio-42d0fb9839211fa66bc156b60dc0419751646fb526997292d0a4510b812c4ebb WatchSource:0}: Error finding container 42d0fb9839211fa66bc156b60dc0419751646fb526997292d0a4510b812c4ebb: Status 404 returned error can't find the container with id 42d0fb9839211fa66bc156b60dc0419751646fb526997292d0a4510b812c4ebb Jul 07 07:03:39.495453 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:39.495418 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" event={"ID":"69bee49b-e02e-4579-87de-e5e11a3894d0","Type":"ContainerStarted","Data":"42d0fb9839211fa66bc156b60dc0419751646fb526997292d0a4510b812c4ebb"} Jul 07 07:03:46.528312 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:46.528277 2565 generic.go:356] "Generic (PLEG): container finished" podID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerID="db4194753aecff8eeeb9f9e610ad35db4882c86ff55800181d671c19af1eb2d2" exitCode=0 Jul 07 07:03:46.528714 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:46.528364 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" event={"ID":"69bee49b-e02e-4579-87de-e5e11a3894d0","Type":"ContainerDied","Data":"db4194753aecff8eeeb9f9e610ad35db4882c86ff55800181d671c19af1eb2d2"} Jul 07 07:03:47.043610 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:47.043558 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 07:03:48.538790 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:48.538759 2565 generic.go:356] "Generic (PLEG): container finished" podID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerID="44088f7e7f369310bee7348ff7dc76365b237cf336b5bae2cc433e40b17ba0d7" exitCode=0 Jul 07 07:03:48.539161 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:48.538810 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" event={"ID":"69bee49b-e02e-4579-87de-e5e11a3894d0","Type":"ContainerDied","Data":"44088f7e7f369310bee7348ff7dc76365b237cf336b5bae2cc433e40b17ba0d7"} Jul 07 07:03:48.539865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:48.539848 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 07:03:56.578301 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:56.578263 2565 generic.go:356] "Generic (PLEG): container finished" podID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerID="3dc8486e39bf5d6a30163384ca686375e83cdf4fd4060496a66178ee55298214" exitCode=0 Jul 07 07:03:56.578724 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:56.578341 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" event={"ID":"69bee49b-e02e-4579-87de-e5e11a3894d0","Type":"ContainerDied","Data":"3dc8486e39bf5d6a30163384ca686375e83cdf4fd4060496a66178ee55298214"} Jul 07 07:03:57.710253 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.710230 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:57.848830 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.848751 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-util\") pod \"69bee49b-e02e-4579-87de-e5e11a3894d0\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " Jul 07 07:03:57.848830 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.848800 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-bundle\") pod \"69bee49b-e02e-4579-87de-e5e11a3894d0\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " Jul 07 07:03:57.849003 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.848893 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtv92\" (UniqueName: \"kubernetes.io/projected/69bee49b-e02e-4579-87de-e5e11a3894d0-kube-api-access-jtv92\") pod \"69bee49b-e02e-4579-87de-e5e11a3894d0\" (UID: \"69bee49b-e02e-4579-87de-e5e11a3894d0\") " Jul 07 07:03:57.849418 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.849391 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-bundle" (OuterVolumeSpecName: "bundle") pod "69bee49b-e02e-4579-87de-e5e11a3894d0" (UID: "69bee49b-e02e-4579-87de-e5e11a3894d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:03:57.850969 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.850947 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69bee49b-e02e-4579-87de-e5e11a3894d0-kube-api-access-jtv92" (OuterVolumeSpecName: "kube-api-access-jtv92") pod "69bee49b-e02e-4579-87de-e5e11a3894d0" (UID: "69bee49b-e02e-4579-87de-e5e11a3894d0"). InnerVolumeSpecName "kube-api-access-jtv92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:03:57.855985 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.855959 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-util" (OuterVolumeSpecName: "util") pod "69bee49b-e02e-4579-87de-e5e11a3894d0" (UID: "69bee49b-e02e-4579-87de-e5e11a3894d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:03:57.949683 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.949647 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtv92\" (UniqueName: \"kubernetes.io/projected/69bee49b-e02e-4579-87de-e5e11a3894d0-kube-api-access-jtv92\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:03:57.949683 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.949676 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-util\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:03:57.949683 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:57.949688 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69bee49b-e02e-4579-87de-e5e11a3894d0-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:03:58.587703 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:58.587677 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" Jul 07 07:03:58.587703 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:58.587686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675407smbr" event={"ID":"69bee49b-e02e-4579-87de-e5e11a3894d0","Type":"ContainerDied","Data":"42d0fb9839211fa66bc156b60dc0419751646fb526997292d0a4510b812c4ebb"} Jul 07 07:03:58.587905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:03:58.587726 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42d0fb9839211fa66bc156b60dc0419751646fb526997292d0a4510b812c4ebb" Jul 07 07:04:06.311886 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.311847 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c"] Jul 07 07:04:06.312289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.312170 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerName="extract" Jul 07 07:04:06.312289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.312182 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerName="extract" Jul 07 07:04:06.312289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.312199 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerName="util" Jul 07 07:04:06.312289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.312204 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerName="util" Jul 07 07:04:06.312289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.312213 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerName="pull" Jul 07 07:04:06.312289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.312219 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerName="pull" Jul 07 07:04:06.312289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.312275 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="69bee49b-e02e-4579-87de-e5e11a3894d0" containerName="extract" Jul 07 07:04:06.316379 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.316360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" Jul 07 07:04:06.319122 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.319076 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 07:04:06.319229 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.319124 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 07:04:06.319229 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.319172 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tw9bh\"" Jul 07 07:04:06.322126 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.322101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x84p6\" (UniqueName: \"kubernetes.io/projected/12583340-6d9c-49fc-8bf5-7d782c60fe54-kube-api-access-x84p6\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkf2c\" (UID: \"12583340-6d9c-49fc-8bf5-7d782c60fe54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" Jul 07 07:04:06.322220 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.322157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12583340-6d9c-49fc-8bf5-7d782c60fe54-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkf2c\" (UID: \"12583340-6d9c-49fc-8bf5-7d782c60fe54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" Jul 07 07:04:06.335241 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.335203 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c"] Jul 07 07:04:06.423244 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.423208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x84p6\" (UniqueName: \"kubernetes.io/projected/12583340-6d9c-49fc-8bf5-7d782c60fe54-kube-api-access-x84p6\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkf2c\" (UID: \"12583340-6d9c-49fc-8bf5-7d782c60fe54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" Jul 07 07:04:06.423454 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.423254 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12583340-6d9c-49fc-8bf5-7d782c60fe54-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkf2c\" (UID: \"12583340-6d9c-49fc-8bf5-7d782c60fe54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" Jul 07 07:04:06.423753 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.423729 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12583340-6d9c-49fc-8bf5-7d782c60fe54-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkf2c\" (UID: \"12583340-6d9c-49fc-8bf5-7d782c60fe54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" Jul 07 07:04:06.436923 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.436896 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x84p6\" (UniqueName: \"kubernetes.io/projected/12583340-6d9c-49fc-8bf5-7d782c60fe54-kube-api-access-x84p6\") pod \"cert-manager-operator-controller-manager-55c444bf86-zkf2c\" (UID: \"12583340-6d9c-49fc-8bf5-7d782c60fe54\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" Jul 07 07:04:06.626022 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.625999 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" Jul 07 07:04:06.767029 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:06.767000 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c"] Jul 07 07:04:06.769744 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:04:06.769709 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12583340_6d9c_49fc_8bf5_7d782c60fe54.slice/crio-1ec91f24d68ca3a6b8264db4189059e774847143bd5a849178105dbddad7e27b WatchSource:0}: Error finding container 1ec91f24d68ca3a6b8264db4189059e774847143bd5a849178105dbddad7e27b: Status 404 returned error can't find the container with id 1ec91f24d68ca3a6b8264db4189059e774847143bd5a849178105dbddad7e27b Jul 07 07:04:07.633857 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:07.633811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" event={"ID":"12583340-6d9c-49fc-8bf5-7d782c60fe54","Type":"ContainerStarted","Data":"1ec91f24d68ca3a6b8264db4189059e774847143bd5a849178105dbddad7e27b"} Jul 07 07:04:08.640111 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:08.640070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" event={"ID":"12583340-6d9c-49fc-8bf5-7d782c60fe54","Type":"ContainerStarted","Data":"e352e0efac388056bbb2bdd995fa86d3b80e85d4a7a1efb75cb4d2f744b07037"} Jul 07 07:04:08.670981 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:08.670931 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zkf2c" podStartSLOduration=1.200021575 podStartE2EDuration="2.670909018s" totalImagesPullingTime="1.470887443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:04:08.670060833 +0000 UTC m=+322.095274101" watchObservedRunningTime="2026-07-07 07:04:08.670909018 +0000 UTC m=+322.096122285" Jul 07 07:04:09.924875 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.924832 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4"] Jul 07 07:04:09.928483 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.928463 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:09.930889 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.930870 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dtm7q\"" Jul 07 07:04:09.930970 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.930893 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 07:04:09.931674 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.931655 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 07:04:09.938597 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.938562 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4"] Jul 07 07:04:09.949332 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.949297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:09.949498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.949400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzxsk\" (UniqueName: \"kubernetes.io/projected/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-kube-api-access-dzxsk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:09.949498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:09.949423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:10.050174 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.050135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzxsk\" (UniqueName: \"kubernetes.io/projected/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-kube-api-access-dzxsk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:10.050174 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.050173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:10.050411 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.050208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:10.050628 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.050607 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:10.050628 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.050622 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:10.064377 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.064340 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzxsk\" (UniqueName: \"kubernetes.io/projected/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-kube-api-access-dzxsk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:10.238743 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.238648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:10.377064 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.377038 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4"] Jul 07 07:04:10.379374 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:04:10.379347 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621f6f12_24b2_4a7c_8c0d_195dd38b84ef.slice/crio-a0ed8f234c8e42181fdfae23d6176914ebe75643777c79cb9a467b9522e89d9b WatchSource:0}: Error finding container a0ed8f234c8e42181fdfae23d6176914ebe75643777c79cb9a467b9522e89d9b: Status 404 returned error can't find the container with id a0ed8f234c8e42181fdfae23d6176914ebe75643777c79cb9a467b9522e89d9b Jul 07 07:04:10.651594 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.651542 2565 generic.go:356] "Generic (PLEG): container finished" podID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerID="c6ab95fe3b802c9ace5979057c07fafd6086bfcd060a2eff8f03f3d8d984cad1" exitCode=0 Jul 07 07:04:10.651768 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.651632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" event={"ID":"621f6f12-24b2-4a7c-8c0d-195dd38b84ef","Type":"ContainerDied","Data":"c6ab95fe3b802c9ace5979057c07fafd6086bfcd060a2eff8f03f3d8d984cad1"} Jul 07 07:04:10.651768 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:10.651687 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" event={"ID":"621f6f12-24b2-4a7c-8c0d-195dd38b84ef","Type":"ContainerStarted","Data":"a0ed8f234c8e42181fdfae23d6176914ebe75643777c79cb9a467b9522e89d9b"} Jul 07 07:04:12.801770 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.801738 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv"] Jul 07 07:04:12.805400 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.805379 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" Jul 07 07:04:12.807655 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.807632 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 07:04:12.807772 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.807668 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 07:04:12.808251 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.808235 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vr6q4\"" Jul 07 07:04:12.816217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.816191 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv"] Jul 07 07:04:12.874846 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.874809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr7gm\" (UniqueName: \"kubernetes.io/projected/91a08fec-6671-49cc-bc31-e321fdecf1b1-kube-api-access-rr7gm\") pod \"cert-manager-cainjector-559cdd8c87-9jxzv\" (UID: \"91a08fec-6671-49cc-bc31-e321fdecf1b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" Jul 07 07:04:12.874846 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.874848 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91a08fec-6671-49cc-bc31-e321fdecf1b1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jxzv\" (UID: \"91a08fec-6671-49cc-bc31-e321fdecf1b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" Jul 07 07:04:12.976173 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.976149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr7gm\" (UniqueName: \"kubernetes.io/projected/91a08fec-6671-49cc-bc31-e321fdecf1b1-kube-api-access-rr7gm\") pod \"cert-manager-cainjector-559cdd8c87-9jxzv\" (UID: \"91a08fec-6671-49cc-bc31-e321fdecf1b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" Jul 07 07:04:12.976281 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.976190 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91a08fec-6671-49cc-bc31-e321fdecf1b1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jxzv\" (UID: \"91a08fec-6671-49cc-bc31-e321fdecf1b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" Jul 07 07:04:12.988248 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.988216 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr7gm\" (UniqueName: \"kubernetes.io/projected/91a08fec-6671-49cc-bc31-e321fdecf1b1-kube-api-access-rr7gm\") pod \"cert-manager-cainjector-559cdd8c87-9jxzv\" (UID: \"91a08fec-6671-49cc-bc31-e321fdecf1b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" Jul 07 07:04:12.988491 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:12.988472 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91a08fec-6671-49cc-bc31-e321fdecf1b1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9jxzv\" (UID: \"91a08fec-6671-49cc-bc31-e321fdecf1b1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" Jul 07 07:04:13.131396 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:13.130977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" Jul 07 07:04:13.274109 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:13.274085 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv"] Jul 07 07:04:13.276557 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:04:13.276535 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91a08fec_6671_49cc_bc31_e321fdecf1b1.slice/crio-e6b8356233b82f2a71e5192c99c2e4094038c6331c2242adfcbdb9cda5832894 WatchSource:0}: Error finding container e6b8356233b82f2a71e5192c99c2e4094038c6331c2242adfcbdb9cda5832894: Status 404 returned error can't find the container with id e6b8356233b82f2a71e5192c99c2e4094038c6331c2242adfcbdb9cda5832894 Jul 07 07:04:13.669448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:13.669415 2565 generic.go:356] "Generic (PLEG): container finished" podID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerID="689c48451c7697e7d9ad2b3099626c59c3de7fc39efa1eed96215daac0aafc2f" exitCode=0 Jul 07 07:04:13.669677 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:13.669506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" event={"ID":"621f6f12-24b2-4a7c-8c0d-195dd38b84ef","Type":"ContainerDied","Data":"689c48451c7697e7d9ad2b3099626c59c3de7fc39efa1eed96215daac0aafc2f"} Jul 07 07:04:13.670753 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:13.670728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" event={"ID":"91a08fec-6671-49cc-bc31-e321fdecf1b1","Type":"ContainerStarted","Data":"e6b8356233b82f2a71e5192c99c2e4094038c6331c2242adfcbdb9cda5832894"} Jul 07 07:04:14.678846 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:14.678808 2565 generic.go:356] "Generic (PLEG): container finished" podID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerID="6833ae2d3c5dc86409962d6dced62795e795913e36415082827a73242d01d1ae" exitCode=0 Jul 07 07:04:14.679290 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:14.678901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" event={"ID":"621f6f12-24b2-4a7c-8c0d-195dd38b84ef","Type":"ContainerDied","Data":"6833ae2d3c5dc86409962d6dced62795e795913e36415082827a73242d01d1ae"} Jul 07 07:04:15.828593 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:15.828556 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:15.906146 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:15.906113 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-util\") pod \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " Jul 07 07:04:15.906325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:15.906157 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzxsk\" (UniqueName: \"kubernetes.io/projected/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-kube-api-access-dzxsk\") pod \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " Jul 07 07:04:15.906325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:15.906219 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-bundle\") pod \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\" (UID: \"621f6f12-24b2-4a7c-8c0d-195dd38b84ef\") " Jul 07 07:04:15.906720 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:15.906689 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-bundle" (OuterVolumeSpecName: "bundle") pod "621f6f12-24b2-4a7c-8c0d-195dd38b84ef" (UID: "621f6f12-24b2-4a7c-8c0d-195dd38b84ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:04:15.908493 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:15.908462 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-kube-api-access-dzxsk" (OuterVolumeSpecName: "kube-api-access-dzxsk") pod "621f6f12-24b2-4a7c-8c0d-195dd38b84ef" (UID: "621f6f12-24b2-4a7c-8c0d-195dd38b84ef"). InnerVolumeSpecName "kube-api-access-dzxsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:04:15.911114 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:15.911087 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-util" (OuterVolumeSpecName: "util") pod "621f6f12-24b2-4a7c-8c0d-195dd38b84ef" (UID: "621f6f12-24b2-4a7c-8c0d-195dd38b84ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:04:16.007568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:16.007470 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-util\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:04:16.007568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:16.007514 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzxsk\" (UniqueName: \"kubernetes.io/projected/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-kube-api-access-dzxsk\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:04:16.007568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:16.007528 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621f6f12-24b2-4a7c-8c0d-195dd38b84ef-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:04:16.690204 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:16.690167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" event={"ID":"91a08fec-6671-49cc-bc31-e321fdecf1b1","Type":"ContainerStarted","Data":"47deb6d0eb97d7d7c07efdc6f4d05dc0776cc4b3de0557dc0cee9d25c711269c"} Jul 07 07:04:16.691863 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:16.691838 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" event={"ID":"621f6f12-24b2-4a7c-8c0d-195dd38b84ef","Type":"ContainerDied","Data":"a0ed8f234c8e42181fdfae23d6176914ebe75643777c79cb9a467b9522e89d9b"} Jul 07 07:04:16.691977 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:16.691874 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmq6f4" Jul 07 07:04:16.691977 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:16.691876 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0ed8f234c8e42181fdfae23d6176914ebe75643777c79cb9a467b9522e89d9b" Jul 07 07:04:16.710002 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:16.709954 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9jxzv" podStartSLOduration=2.288293559 podStartE2EDuration="4.709937527s" totalImagesPullingTime="2.421643968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:04:16.708026177 +0000 UTC m=+330.133239445" watchObservedRunningTime="2026-07-07 07:04:16.709937527 +0000 UTC m=+330.135150796" Jul 07 07:04:29.179935 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.179896 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g"] Jul 07 07:04:29.180416 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.180231 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerName="pull" Jul 07 07:04:29.180416 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.180241 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerName="pull" Jul 07 07:04:29.180416 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.180254 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerName="util" Jul 07 07:04:29.180416 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.180259 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerName="util" Jul 07 07:04:29.180416 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.180275 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerName="extract" Jul 07 07:04:29.180416 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.180280 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerName="extract" Jul 07 07:04:29.180416 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.180336 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="621f6f12-24b2-4a7c-8c0d-195dd38b84ef" containerName="extract" Jul 07 07:04:29.183561 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.183545 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.186066 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.186044 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 07:04:29.186741 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.186725 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dtm7q\"" Jul 07 07:04:29.186796 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.186767 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 07:04:29.192853 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.192826 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g"] Jul 07 07:04:29.221949 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.221906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.222137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.221964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.222137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.221994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzf79\" (UniqueName: \"kubernetes.io/projected/2ac15984-4424-4071-99f7-cfc62c97f313-kube-api-access-nzf79\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.322869 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.322831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.322869 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.322869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzf79\" (UniqueName: \"kubernetes.io/projected/2ac15984-4424-4071-99f7-cfc62c97f313-kube-api-access-nzf79\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.323101 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.322944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.323223 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.323203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.323277 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.323236 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.332844 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.332811 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzf79\" (UniqueName: \"kubernetes.io/projected/2ac15984-4424-4071-99f7-cfc62c97f313-kube-api-access-nzf79\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.493689 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.493607 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:29.630234 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.630208 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g"] Jul 07 07:04:29.632830 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:04:29.632804 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac15984_4424_4071_99f7_cfc62c97f313.slice/crio-149a0daa887ebd9c2270ae3d75578dfa7c217e05dceef938862905e6c3721cea WatchSource:0}: Error finding container 149a0daa887ebd9c2270ae3d75578dfa7c217e05dceef938862905e6c3721cea: Status 404 returned error can't find the container with id 149a0daa887ebd9c2270ae3d75578dfa7c217e05dceef938862905e6c3721cea Jul 07 07:04:29.754369 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.754281 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ac15984-4424-4071-99f7-cfc62c97f313" containerID="cfec0818cc65edd9a0c47554d959d968eb1af1dd25f486d9f9edabd116886bcc" exitCode=0 Jul 07 07:04:29.754533 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.754368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" event={"ID":"2ac15984-4424-4071-99f7-cfc62c97f313","Type":"ContainerDied","Data":"cfec0818cc65edd9a0c47554d959d968eb1af1dd25f486d9f9edabd116886bcc"} Jul 07 07:04:29.754533 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:29.754417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" event={"ID":"2ac15984-4424-4071-99f7-cfc62c97f313","Type":"ContainerStarted","Data":"149a0daa887ebd9c2270ae3d75578dfa7c217e05dceef938862905e6c3721cea"} Jul 07 07:04:30.621723 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.621687 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qmjx"] Jul 07 07:04:30.625034 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.625012 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9qmjx" Jul 07 07:04:30.627365 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.627347 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-d6cpp\"" Jul 07 07:04:30.635959 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.635933 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qmjx"] Jul 07 07:04:30.734440 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.734405 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1af258af-b9ce-4642-aea5-d861dc5e52cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qmjx\" (UID: \"1af258af-b9ce-4642-aea5-d861dc5e52cf\") " pod="cert-manager/cert-manager-55b4d954d5-9qmjx" Jul 07 07:04:30.734672 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.734455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vskbn\" (UniqueName: \"kubernetes.io/projected/1af258af-b9ce-4642-aea5-d861dc5e52cf-kube-api-access-vskbn\") pod \"cert-manager-55b4d954d5-9qmjx\" (UID: \"1af258af-b9ce-4642-aea5-d861dc5e52cf\") " pod="cert-manager/cert-manager-55b4d954d5-9qmjx" Jul 07 07:04:30.761725 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.761697 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ac15984-4424-4071-99f7-cfc62c97f313" containerID="8edbf0de2ba20ccfabbf4c95af814dd08868c1ab9c466c3b8cc3331eff759ac2" exitCode=0 Jul 07 07:04:30.761889 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.761780 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" event={"ID":"2ac15984-4424-4071-99f7-cfc62c97f313","Type":"ContainerDied","Data":"8edbf0de2ba20ccfabbf4c95af814dd08868c1ab9c466c3b8cc3331eff759ac2"} Jul 07 07:04:30.835035 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.835008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1af258af-b9ce-4642-aea5-d861dc5e52cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qmjx\" (UID: \"1af258af-b9ce-4642-aea5-d861dc5e52cf\") " pod="cert-manager/cert-manager-55b4d954d5-9qmjx" Jul 07 07:04:30.835190 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.835051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vskbn\" (UniqueName: \"kubernetes.io/projected/1af258af-b9ce-4642-aea5-d861dc5e52cf-kube-api-access-vskbn\") pod \"cert-manager-55b4d954d5-9qmjx\" (UID: \"1af258af-b9ce-4642-aea5-d861dc5e52cf\") " pod="cert-manager/cert-manager-55b4d954d5-9qmjx" Jul 07 07:04:30.844722 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.844690 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1af258af-b9ce-4642-aea5-d861dc5e52cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-9qmjx\" (UID: \"1af258af-b9ce-4642-aea5-d861dc5e52cf\") " pod="cert-manager/cert-manager-55b4d954d5-9qmjx" Jul 07 07:04:30.844843 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.844749 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vskbn\" (UniqueName: \"kubernetes.io/projected/1af258af-b9ce-4642-aea5-d861dc5e52cf-kube-api-access-vskbn\") pod \"cert-manager-55b4d954d5-9qmjx\" (UID: \"1af258af-b9ce-4642-aea5-d861dc5e52cf\") " pod="cert-manager/cert-manager-55b4d954d5-9qmjx" Jul 07 07:04:30.934986 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:30.934951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9qmjx" Jul 07 07:04:31.068987 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:31.068948 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9qmjx"] Jul 07 07:04:31.071658 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:04:31.071624 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1af258af_b9ce_4642_aea5_d861dc5e52cf.slice/crio-e689a95bb330a5d7f6d85642534fae7d21577d45945f608f38d11b245ff7bb3a WatchSource:0}: Error finding container e689a95bb330a5d7f6d85642534fae7d21577d45945f608f38d11b245ff7bb3a: Status 404 returned error can't find the container with id e689a95bb330a5d7f6d85642534fae7d21577d45945f608f38d11b245ff7bb3a Jul 07 07:04:31.767948 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:31.767853 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9qmjx" event={"ID":"1af258af-b9ce-4642-aea5-d861dc5e52cf","Type":"ContainerStarted","Data":"5914e63257696746a9302771db53405b024e42f8b62ba60171651a93852a2c14"} Jul 07 07:04:31.767948 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:31.767896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9qmjx" event={"ID":"1af258af-b9ce-4642-aea5-d861dc5e52cf","Type":"ContainerStarted","Data":"e689a95bb330a5d7f6d85642534fae7d21577d45945f608f38d11b245ff7bb3a"} Jul 07 07:04:31.769916 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:31.769893 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ac15984-4424-4071-99f7-cfc62c97f313" containerID="dc23e009985f2fcacde3be3a52711332723e4aefd8fed4c05eb81effc8fabb66" exitCode=0 Jul 07 07:04:31.770015 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:31.769931 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" event={"ID":"2ac15984-4424-4071-99f7-cfc62c97f313","Type":"ContainerDied","Data":"dc23e009985f2fcacde3be3a52711332723e4aefd8fed4c05eb81effc8fabb66"} Jul 07 07:04:31.787010 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:31.786962 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9qmjx" podStartSLOduration=1.786947199 podStartE2EDuration="1.786947199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:04:31.785802044 +0000 UTC m=+345.211015314" watchObservedRunningTime="2026-07-07 07:04:31.786947199 +0000 UTC m=+345.212160471" Jul 07 07:04:32.904252 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:32.904226 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:32.955785 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:32.955754 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzf79\" (UniqueName: \"kubernetes.io/projected/2ac15984-4424-4071-99f7-cfc62c97f313-kube-api-access-nzf79\") pod \"2ac15984-4424-4071-99f7-cfc62c97f313\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " Jul 07 07:04:32.955970 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:32.955805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-util\") pod \"2ac15984-4424-4071-99f7-cfc62c97f313\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " Jul 07 07:04:32.955970 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:32.955877 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-bundle\") pod \"2ac15984-4424-4071-99f7-cfc62c97f313\" (UID: \"2ac15984-4424-4071-99f7-cfc62c97f313\") " Jul 07 07:04:32.956620 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:32.956577 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-bundle" (OuterVolumeSpecName: "bundle") pod "2ac15984-4424-4071-99f7-cfc62c97f313" (UID: "2ac15984-4424-4071-99f7-cfc62c97f313"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:04:32.958032 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:32.958006 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac15984-4424-4071-99f7-cfc62c97f313-kube-api-access-nzf79" (OuterVolumeSpecName: "kube-api-access-nzf79") pod "2ac15984-4424-4071-99f7-cfc62c97f313" (UID: "2ac15984-4424-4071-99f7-cfc62c97f313"). InnerVolumeSpecName "kube-api-access-nzf79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:04:32.961620 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:32.961579 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-util" (OuterVolumeSpecName: "util") pod "2ac15984-4424-4071-99f7-cfc62c97f313" (UID: "2ac15984-4424-4071-99f7-cfc62c97f313"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:04:33.056814 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:33.056715 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:04:33.056814 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:33.056757 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzf79\" (UniqueName: \"kubernetes.io/projected/2ac15984-4424-4071-99f7-cfc62c97f313-kube-api-access-nzf79\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:04:33.056814 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:33.056770 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac15984-4424-4071-99f7-cfc62c97f313-util\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:04:33.781529 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:33.781492 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" event={"ID":"2ac15984-4424-4071-99f7-cfc62c97f313","Type":"ContainerDied","Data":"149a0daa887ebd9c2270ae3d75578dfa7c217e05dceef938862905e6c3721cea"} Jul 07 07:04:33.781529 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:33.781517 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj4p6g" Jul 07 07:04:33.781764 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:33.781543 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="149a0daa887ebd9c2270ae3d75578dfa7c217e05dceef938862905e6c3721cea" Jul 07 07:04:41.545310 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.545222 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb"] Jul 07 07:04:41.545787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.545658 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac15984-4424-4071-99f7-cfc62c97f313" containerName="util" Jul 07 07:04:41.545787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.545675 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac15984-4424-4071-99f7-cfc62c97f313" containerName="util" Jul 07 07:04:41.545787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.545686 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac15984-4424-4071-99f7-cfc62c97f313" containerName="extract" Jul 07 07:04:41.545787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.545691 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac15984-4424-4071-99f7-cfc62c97f313" containerName="extract" Jul 07 07:04:41.545787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.545710 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac15984-4424-4071-99f7-cfc62c97f313" containerName="pull" Jul 07 07:04:41.545787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.545717 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac15984-4424-4071-99f7-cfc62c97f313" containerName="pull" Jul 07 07:04:41.546064 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.545793 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac15984-4424-4071-99f7-cfc62c97f313" containerName="extract" Jul 07 07:04:41.549209 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.549191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.551781 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.551751 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lpw58\"" Jul 07 07:04:41.551915 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.551759 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 07:04:41.551915 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.551808 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 07:04:41.552069 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.552054 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 07:04:41.552270 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.552254 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 07:04:41.562538 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.562500 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb"] Jul 07 07:04:41.638821 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.638781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9633bb19-6f0a-414a-abfe-31ac61e45e20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.639003 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.638829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9633bb19-6f0a-414a-abfe-31ac61e45e20-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.639003 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.638906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqck\" (UniqueName: \"kubernetes.io/projected/9633bb19-6f0a-414a-abfe-31ac61e45e20-kube-api-access-qrqck\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.639003 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.638960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9633bb19-6f0a-414a-abfe-31ac61e45e20-tmp\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.639148 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.639026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9633bb19-6f0a-414a-abfe-31ac61e45e20-manifests\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.739656 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.739616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9633bb19-6f0a-414a-abfe-31ac61e45e20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.739833 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.739667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9633bb19-6f0a-414a-abfe-31ac61e45e20-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.739833 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.739696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqck\" (UniqueName: \"kubernetes.io/projected/9633bb19-6f0a-414a-abfe-31ac61e45e20-kube-api-access-qrqck\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.739833 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.739718 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9633bb19-6f0a-414a-abfe-31ac61e45e20-tmp\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.739833 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.739746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9633bb19-6f0a-414a-abfe-31ac61e45e20-manifests\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.740226 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.740203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9633bb19-6f0a-414a-abfe-31ac61e45e20-manifests\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.742084 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.742060 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9633bb19-6f0a-414a-abfe-31ac61e45e20-tmp\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.742428 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.742405 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9633bb19-6f0a-414a-abfe-31ac61e45e20-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.742505 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.742405 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9633bb19-6f0a-414a-abfe-31ac61e45e20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.750859 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.750832 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqck\" (UniqueName: \"kubernetes.io/projected/9633bb19-6f0a-414a-abfe-31ac61e45e20-kube-api-access-qrqck\") pod \"opendatahub-operator-controller-manager-dbf9cc589-cj7hb\" (UID: \"9633bb19-6f0a-414a-abfe-31ac61e45e20\") " pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:41.860666 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:41.860618 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:42.036460 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:42.036426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb"] Jul 07 07:04:42.041438 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:04:42.041409 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9633bb19_6f0a_414a_abfe_31ac61e45e20.slice/crio-e304580e1ef903a3187028b6de9247c18b46db62168c6f1bd47edcccf44426e0 WatchSource:0}: Error finding container e304580e1ef903a3187028b6de9247c18b46db62168c6f1bd47edcccf44426e0: Status 404 returned error can't find the container with id e304580e1ef903a3187028b6de9247c18b46db62168c6f1bd47edcccf44426e0 Jul 07 07:04:42.830067 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:42.830031 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" event={"ID":"9633bb19-6f0a-414a-abfe-31ac61e45e20","Type":"ContainerStarted","Data":"e304580e1ef903a3187028b6de9247c18b46db62168c6f1bd47edcccf44426e0"} Jul 07 07:04:45.848738 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:45.848695 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" event={"ID":"9633bb19-6f0a-414a-abfe-31ac61e45e20","Type":"ContainerStarted","Data":"7d98e1a521fe632fd0800bbd8770c354a7c3c3344d389b0fd7e0f4ad45046ac7"} Jul 07 07:04:46.855080 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:46.855045 2565 generic.go:356] "Generic (PLEG): container finished" podID="9633bb19-6f0a-414a-abfe-31ac61e45e20" containerID="7d98e1a521fe632fd0800bbd8770c354a7c3c3344d389b0fd7e0f4ad45046ac7" exitCode=0 Jul 07 07:04:46.855497 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:46.855136 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" event={"ID":"9633bb19-6f0a-414a-abfe-31ac61e45e20","Type":"ContainerDied","Data":"7d98e1a521fe632fd0800bbd8770c354a7c3c3344d389b0fd7e0f4ad45046ac7"} Jul 07 07:04:47.862085 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:47.862051 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" event={"ID":"9633bb19-6f0a-414a-abfe-31ac61e45e20","Type":"ContainerStarted","Data":"292945d6400557779d8abd3836889125db22c3bceaf836265f79e92cb0861d9e"} Jul 07 07:04:47.862485 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:47.862170 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:04:47.887380 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:47.887326 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" podStartSLOduration=2.400546135 podStartE2EDuration="6.887309491s" totalImagesPullingTime="3.456194918s" totalInitContainerRuntime="1.030568438s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:04:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:04:47.884407535 +0000 UTC m=+361.309620801" watchObservedRunningTime="2026-07-07 07:04:47.887309491 +0000 UTC m=+361.312522759" Jul 07 07:04:58.868683 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:04:58.868649 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dbf9cc589-cj7hb" Jul 07 07:05:02.178119 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.178079 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m"] Jul 07 07:05:02.186267 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.186243 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.192458 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.192430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 07:05:02.193302 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.192853 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pn7dq\"" Jul 07 07:05:02.193302 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.192883 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 07:05:02.193302 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.192943 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 07:05:02.193302 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.193256 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 07:05:02.193554 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.193515 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 07:05:02.196014 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.195994 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m"] Jul 07 07:05:02.219835 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.219807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-cert\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.219975 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.219853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b772h\" (UniqueName: \"kubernetes.io/projected/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-kube-api-access-b772h\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.219975 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.219924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-metrics-cert\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.220069 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.219982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-manager-config\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.320572 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.320533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-cert\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.320572 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.320599 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b772h\" (UniqueName: \"kubernetes.io/projected/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-kube-api-access-b772h\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.320849 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.320639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-metrics-cert\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.320849 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.320671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-manager-config\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.321321 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.321299 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-manager-config\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.323098 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.323076 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-metrics-cert\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.323201 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.323121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-cert\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.339919 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.339890 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b772h\" (UniqueName: \"kubernetes.io/projected/fb347d3b-2068-4c27-8a1f-4ced8b174fa9-kube-api-access-b772h\") pod \"lws-controller-manager-5c6f759dd-q2v7m\" (UID: \"fb347d3b-2068-4c27-8a1f-4ced8b174fa9\") " pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.496905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.496804 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:02.665612 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.665573 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m"] Jul 07 07:05:02.667457 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:05:02.667429 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb347d3b_2068_4c27_8a1f_4ced8b174fa9.slice/crio-79ff9c48eaa783ce3231c4c7221e7e969ba7b04abf81d68e295ba53dbe07d2fe WatchSource:0}: Error finding container 79ff9c48eaa783ce3231c4c7221e7e969ba7b04abf81d68e295ba53dbe07d2fe: Status 404 returned error can't find the container with id 79ff9c48eaa783ce3231c4c7221e7e969ba7b04abf81d68e295ba53dbe07d2fe Jul 07 07:05:02.936455 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:02.936422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" event={"ID":"fb347d3b-2068-4c27-8a1f-4ced8b174fa9","Type":"ContainerStarted","Data":"79ff9c48eaa783ce3231c4c7221e7e969ba7b04abf81d68e295ba53dbe07d2fe"} Jul 07 07:05:04.948116 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:04.948079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" event={"ID":"fb347d3b-2068-4c27-8a1f-4ced8b174fa9","Type":"ContainerStarted","Data":"d5e894efa0c8dd6acdbfaf12b645e7bca5a62bd6bc9c5de31b7aa9f4782559c8"} Jul 07 07:05:04.948497 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:04.948182 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:05:04.967849 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:04.967797 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" podStartSLOduration=1.568095613 podStartE2EDuration="2.967782438s" totalImagesPullingTime="1.399686825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:05:04.966562417 +0000 UTC m=+378.391775699" watchObservedRunningTime="2026-07-07 07:05:04.967782438 +0000 UTC m=+378.392995707" Jul 07 07:05:09.788101 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.788066 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw"] Jul 07 07:05:09.791593 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.791564 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.794346 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.794324 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cmdtm\"" Jul 07 07:05:09.795020 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.795001 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 07:05:09.810100 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.810072 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw"] Jul 07 07:05:09.886163 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.886336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.886336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.886336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.886442 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.886442 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vwr5\" (UniqueName: \"kubernetes.io/projected/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-kube-api-access-7vwr5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.886442 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.886442 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.886577 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.886468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.987802 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.987763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988012 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.987814 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vwr5\" (UniqueName: \"kubernetes.io/projected/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-kube-api-access-7vwr5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988012 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.987844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988012 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.987982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988269 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988243 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988430 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988405 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988485 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988532 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988608 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988667 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988832 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.988998 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.988979 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.989229 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.989208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.990667 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.990646 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:09.990759 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:09.990740 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:10.000777 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:10.000756 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:10.000871 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:10.000786 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vwr5\" (UniqueName: \"kubernetes.io/projected/c2de6520-4a95-4908-87dd-9a9b8b3d22f2-kube-api-access-7vwr5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fdtqw\" (UID: \"c2de6520-4a95-4908-87dd-9a9b8b3d22f2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:10.101606 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:10.101534 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:10.248170 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:10.248141 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw"] Jul 07 07:05:10.249568 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:05:10.249532 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2de6520_4a95_4908_87dd_9a9b8b3d22f2.slice/crio-cb406bb7001f045cb51707d75afc10c11ede0efffdd4fc501becb1e7edc8ac51 WatchSource:0}: Error finding container cb406bb7001f045cb51707d75afc10c11ede0efffdd4fc501becb1e7edc8ac51: Status 404 returned error can't find the container with id cb406bb7001f045cb51707d75afc10c11ede0efffdd4fc501becb1e7edc8ac51 Jul 07 07:05:10.982166 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:10.982127 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" event={"ID":"c2de6520-4a95-4908-87dd-9a9b8b3d22f2","Type":"ContainerStarted","Data":"cb406bb7001f045cb51707d75afc10c11ede0efffdd4fc501becb1e7edc8ac51"} Jul 07 07:05:12.904963 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:12.904925 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:05:12.905242 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:12.904997 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:05:12.905242 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:12.905025 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:05:12.997388 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:12.997347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" event={"ID":"c2de6520-4a95-4908-87dd-9a9b8b3d22f2","Type":"ContainerStarted","Data":"c6a365f10c357958c297dfef67caea8fba47b1e7c16d989e30cda47dc95bd1e9"} Jul 07 07:05:13.036187 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:13.036122 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" podStartSLOduration=1.383064128 podStartE2EDuration="4.036102155s" totalImagesPullingTime="2.653038027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:05:13.032448401 +0000 UTC m=+386.457661669" watchObservedRunningTime="2026-07-07 07:05:13.036102155 +0000 UTC m=+386.461315424" Jul 07 07:05:13.102252 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:13.102216 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:13.103598 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:13.103564 2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 07 07:05:13.103726 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:13.103628 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" podUID="c2de6520-4a95-4908-87dd-9a9b8b3d22f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 07 07:05:14.106358 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:14.106324 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:15.013809 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:15.013776 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:15.014811 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:15.014787 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fdtqw" Jul 07 07:05:15.956198 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:05:15.956168 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c6f759dd-q2v7m" Jul 07 07:06:02.206372 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.206328 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktj79"] Jul 07 07:06:02.216684 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.216652 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" Jul 07 07:06:02.219638 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.219605 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 07:06:02.219782 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.219747 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 07:06:02.220382 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.220360 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6dt25\"" Jul 07 07:06:02.223023 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.222996 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktj79"] Jul 07 07:06:02.251698 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.251662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dqqv\" (UniqueName: \"kubernetes.io/projected/37496f45-79ac-41a1-970f-7a67b654e9b2-kube-api-access-9dqqv\") pod \"kuadrant-operator-catalog-ktj79\" (UID: \"37496f45-79ac-41a1-970f-7a67b654e9b2\") " pod="kuadrant-system/kuadrant-operator-catalog-ktj79" Jul 07 07:06:02.352662 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.352619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dqqv\" (UniqueName: \"kubernetes.io/projected/37496f45-79ac-41a1-970f-7a67b654e9b2-kube-api-access-9dqqv\") pod \"kuadrant-operator-catalog-ktj79\" (UID: \"37496f45-79ac-41a1-970f-7a67b654e9b2\") " pod="kuadrant-system/kuadrant-operator-catalog-ktj79" Jul 07 07:06:02.362672 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.362640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dqqv\" (UniqueName: \"kubernetes.io/projected/37496f45-79ac-41a1-970f-7a67b654e9b2-kube-api-access-9dqqv\") pod \"kuadrant-operator-catalog-ktj79\" (UID: \"37496f45-79ac-41a1-970f-7a67b654e9b2\") " pod="kuadrant-system/kuadrant-operator-catalog-ktj79" Jul 07 07:06:02.529475 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.529375 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" Jul 07 07:06:02.587563 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.587520 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktj79"] Jul 07 07:06:02.672154 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.672132 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktj79"] Jul 07 07:06:02.674452 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:02.674424 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37496f45_79ac_41a1_970f_7a67b654e9b2.slice/crio-19de076018c3c1fe99a2710d635d182d18bffc465706e16c25cd9558d4751756 WatchSource:0}: Error finding container 19de076018c3c1fe99a2710d635d182d18bffc465706e16c25cd9558d4751756: Status 404 returned error can't find the container with id 19de076018c3c1fe99a2710d635d182d18bffc465706e16c25cd9558d4751756 Jul 07 07:06:02.783294 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.783203 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g5hck"] Jul 07 07:06:02.788177 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.788153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:02.799021 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.798992 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g5hck"] Jul 07 07:06:02.858037 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.857996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56cql\" (UniqueName: \"kubernetes.io/projected/5ff1d1d5-729c-4efb-8562-670a48268303-kube-api-access-56cql\") pod \"kuadrant-operator-catalog-g5hck\" (UID: \"5ff1d1d5-729c-4efb-8562-670a48268303\") " pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:02.958546 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.958513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56cql\" (UniqueName: \"kubernetes.io/projected/5ff1d1d5-729c-4efb-8562-670a48268303-kube-api-access-56cql\") pod \"kuadrant-operator-catalog-g5hck\" (UID: \"5ff1d1d5-729c-4efb-8562-670a48268303\") " pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:02.997256 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:02.997218 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56cql\" (UniqueName: \"kubernetes.io/projected/5ff1d1d5-729c-4efb-8562-670a48268303-kube-api-access-56cql\") pod \"kuadrant-operator-catalog-g5hck\" (UID: \"5ff1d1d5-729c-4efb-8562-670a48268303\") " pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:03.098302 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:03.098267 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:03.241196 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:03.241166 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g5hck"] Jul 07 07:06:03.242819 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:03.242794 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff1d1d5_729c_4efb_8562_670a48268303.slice/crio-0dda99660d10c76fd003968ac78069fc2dfabbb9d953792f83e52105834f061b WatchSource:0}: Error finding container 0dda99660d10c76fd003968ac78069fc2dfabbb9d953792f83e52105834f061b: Status 404 returned error can't find the container with id 0dda99660d10c76fd003968ac78069fc2dfabbb9d953792f83e52105834f061b Jul 07 07:06:03.252903 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:03.252875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" event={"ID":"37496f45-79ac-41a1-970f-7a67b654e9b2","Type":"ContainerStarted","Data":"19de076018c3c1fe99a2710d635d182d18bffc465706e16c25cd9558d4751756"} Jul 07 07:06:03.254030 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:03.254001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" event={"ID":"5ff1d1d5-729c-4efb-8562-670a48268303","Type":"ContainerStarted","Data":"0dda99660d10c76fd003968ac78069fc2dfabbb9d953792f83e52105834f061b"} Jul 07 07:06:06.270696 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.270634 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" event={"ID":"37496f45-79ac-41a1-970f-7a67b654e9b2","Type":"ContainerStarted","Data":"175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc"} Jul 07 07:06:06.270696 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.270676 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" podUID="37496f45-79ac-41a1-970f-7a67b654e9b2" containerName="registry-server" containerID="cri-o://175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc" gracePeriod=2 Jul 07 07:06:06.272103 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.272083 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" event={"ID":"5ff1d1d5-729c-4efb-8562-670a48268303","Type":"ContainerStarted","Data":"c74212f64a62f1709ee98b25b2f3bc3fbde6c98180bfadda5b098c0f839d7534"} Jul 07 07:06:06.287653 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.287578 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" podStartSLOduration=1.5423753150000001 podStartE2EDuration="4.287557694s" totalImagesPullingTime="2.745182379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:06:06.287053791 +0000 UTC m=+439.712267063" watchObservedRunningTime="2026-07-07 07:06:06.287557694 +0000 UTC m=+439.712770963" Jul 07 07:06:06.304683 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.304636 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" podStartSLOduration=2.124421829 podStartE2EDuration="4.304620486s" totalImagesPullingTime="2.180198657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:06:06.302905514 +0000 UTC m=+439.728118783" watchObservedRunningTime="2026-07-07 07:06:06.304620486 +0000 UTC m=+439.729833755" Jul 07 07:06:06.516688 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.516664 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" Jul 07 07:06:06.597504 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.597471 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dqqv\" (UniqueName: \"kubernetes.io/projected/37496f45-79ac-41a1-970f-7a67b654e9b2-kube-api-access-9dqqv\") pod \"37496f45-79ac-41a1-970f-7a67b654e9b2\" (UID: \"37496f45-79ac-41a1-970f-7a67b654e9b2\") " Jul 07 07:06:06.599638 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.599608 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37496f45-79ac-41a1-970f-7a67b654e9b2-kube-api-access-9dqqv" (OuterVolumeSpecName: "kube-api-access-9dqqv") pod "37496f45-79ac-41a1-970f-7a67b654e9b2" (UID: "37496f45-79ac-41a1-970f-7a67b654e9b2"). InnerVolumeSpecName "kube-api-access-9dqqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:06:06.704641 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:06.699838 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dqqv\" (UniqueName: \"kubernetes.io/projected/37496f45-79ac-41a1-970f-7a67b654e9b2-kube-api-access-9dqqv\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:07.278064 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.278031 2565 generic.go:356] "Generic (PLEG): container finished" podID="37496f45-79ac-41a1-970f-7a67b654e9b2" containerID="175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc" exitCode=0 Jul 07 07:06:07.278549 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.278096 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" Jul 07 07:06:07.278549 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.278114 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" event={"ID":"37496f45-79ac-41a1-970f-7a67b654e9b2","Type":"ContainerDied","Data":"175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc"} Jul 07 07:06:07.278549 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.278165 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ktj79" event={"ID":"37496f45-79ac-41a1-970f-7a67b654e9b2","Type":"ContainerDied","Data":"19de076018c3c1fe99a2710d635d182d18bffc465706e16c25cd9558d4751756"} Jul 07 07:06:07.278549 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.278181 2565 scope.go:117] "RemoveContainer" containerID="175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc" Jul 07 07:06:07.287342 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.287324 2565 scope.go:117] "RemoveContainer" containerID="175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc" Jul 07 07:06:07.287618 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:07.287575 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc\": container with ID starting with 175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc not found: ID does not exist" containerID="175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc" Jul 07 07:06:07.287692 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.287628 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc"} err="failed to get container status \"175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc\": rpc error: code = NotFound desc = could not find container \"175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc\": container with ID starting with 175835bee4a35bf6a526400f8af9605166efcece3bd38d6d8d0913414b1da4dc not found: ID does not exist" Jul 07 07:06:07.296148 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.296122 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktj79"] Jul 07 07:06:07.297944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:07.297925 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ktj79"] Jul 07 07:06:09.134142 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:09.134109 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37496f45-79ac-41a1-970f-7a67b654e9b2" path="/var/lib/kubelet/pods/37496f45-79ac-41a1-970f-7a67b654e9b2/volumes" Jul 07 07:06:13.099410 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:13.099372 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:13.099858 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:13.099434 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:13.122189 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:13.122164 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:13.331796 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:13.331771 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-g5hck" Jul 07 07:06:17.620309 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.620270 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r"] Jul 07 07:06:17.620717 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.620660 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37496f45-79ac-41a1-970f-7a67b654e9b2" containerName="registry-server" Jul 07 07:06:17.620717 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.620671 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37496f45-79ac-41a1-970f-7a67b654e9b2" containerName="registry-server" Jul 07 07:06:17.620788 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.620742 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37496f45-79ac-41a1-970f-7a67b654e9b2" containerName="registry-server" Jul 07 07:06:17.624137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.624114 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.626553 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.626532 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dbd4w\"" Jul 07 07:06:17.633761 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.633736 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r"] Jul 07 07:06:17.701780 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.701743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.701780 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.701780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.702002 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.701811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmqmh\" (UniqueName: \"kubernetes.io/projected/e11f6777-0521-46ea-aac2-47445ec99495-kube-api-access-mmqmh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.803194 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.803143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.803194 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.803200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.803448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.803252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqmh\" (UniqueName: \"kubernetes.io/projected/e11f6777-0521-46ea-aac2-47445ec99495-kube-api-access-mmqmh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.803671 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.803643 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.803797 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.803696 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.813457 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.813431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmqmh\" (UniqueName: \"kubernetes.io/projected/e11f6777-0521-46ea-aac2-47445ec99495-kube-api-access-mmqmh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:17.934516 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:17.934429 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:18.072483 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.072455 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r"] Jul 07 07:06:18.074376 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:18.074350 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11f6777_0521_46ea_aac2_47445ec99495.slice/crio-c2fe84fce4c8e23e30a8664d76851b7814645d49b1b90691ae736c830c2ac98f WatchSource:0}: Error finding container c2fe84fce4c8e23e30a8664d76851b7814645d49b1b90691ae736c830c2ac98f: Status 404 returned error can't find the container with id c2fe84fce4c8e23e30a8664d76851b7814645d49b1b90691ae736c830c2ac98f Jul 07 07:06:18.246831 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.246749 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76"] Jul 07 07:06:18.250371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.250353 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.259726 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.259696 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76"] Jul 07 07:06:18.336710 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.336679 2565 generic.go:356] "Generic (PLEG): container finished" podID="e11f6777-0521-46ea-aac2-47445ec99495" containerID="b4b3edea9b4a26b0d4ca6b6cf183d58f254a13508f8da7aec1c2ffbacc3fd8e2" exitCode=0 Jul 07 07:06:18.336927 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.336780 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" event={"ID":"e11f6777-0521-46ea-aac2-47445ec99495","Type":"ContainerDied","Data":"b4b3edea9b4a26b0d4ca6b6cf183d58f254a13508f8da7aec1c2ffbacc3fd8e2"} Jul 07 07:06:18.336927 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.336838 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" event={"ID":"e11f6777-0521-46ea-aac2-47445ec99495","Type":"ContainerStarted","Data":"c2fe84fce4c8e23e30a8664d76851b7814645d49b1b90691ae736c830c2ac98f"} Jul 07 07:06:18.408548 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.408506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.408548 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.408562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxx25\" (UniqueName: \"kubernetes.io/projected/f78957d9-8c58-4f95-8bfd-5a8013ce7381-kube-api-access-wxx25\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.408827 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.408670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.510297 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.510211 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.510297 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.510267 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxx25\" (UniqueName: \"kubernetes.io/projected/f78957d9-8c58-4f95-8bfd-5a8013ce7381-kube-api-access-wxx25\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.510453 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.510403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.510648 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.510631 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.510754 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.510737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.520229 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.520209 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxx25\" (UniqueName: \"kubernetes.io/projected/f78957d9-8c58-4f95-8bfd-5a8013ce7381-kube-api-access-wxx25\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.559821 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.559787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:18.627411 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.627380 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm"] Jul 07 07:06:18.632030 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.632011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.642029 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.642003 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm"] Jul 07 07:06:18.702959 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.702935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76"] Jul 07 07:06:18.705555 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:18.705527 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78957d9_8c58_4f95_8bfd_5a8013ce7381.slice/crio-78192c6035c1526ddc45e8f1e6814dc1b1ef7db09f9f35f29fbbcc8de5576302 WatchSource:0}: Error finding container 78192c6035c1526ddc45e8f1e6814dc1b1ef7db09f9f35f29fbbcc8de5576302: Status 404 returned error can't find the container with id 78192c6035c1526ddc45e8f1e6814dc1b1ef7db09f9f35f29fbbcc8de5576302 Jul 07 07:06:18.712766 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.712747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.712824 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.712791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.712864 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.712838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4kkt\" (UniqueName: \"kubernetes.io/projected/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-kube-api-access-n4kkt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.814202 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.814169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.814202 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.814207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4kkt\" (UniqueName: \"kubernetes.io/projected/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-kube-api-access-n4kkt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.814376 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.814276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.814548 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.814529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.814611 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.814555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.823864 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.823841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4kkt\" (UniqueName: \"kubernetes.io/projected/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-kube-api-access-n4kkt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:18.942697 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:18.942654 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:19.019558 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.019528 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7"] Jul 07 07:06:19.032024 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.031986 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.038791 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.038758 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7"] Jul 07 07:06:19.088753 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.088725 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm"] Jul 07 07:06:19.090445 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:19.090422 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9434e0_97b8_49a2_a87c_89bd5ef032ae.slice/crio-e2c571393deeb211788e28728b2e72f9c3b89f5a0940da74ff921d78fc60aa19 WatchSource:0}: Error finding container e2c571393deeb211788e28728b2e72f9c3b89f5a0940da74ff921d78fc60aa19: Status 404 returned error can't find the container with id e2c571393deeb211788e28728b2e72f9c3b89f5a0940da74ff921d78fc60aa19 Jul 07 07:06:19.118082 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.118056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/fca513d1-6510-49d1-b523-740366056700-kube-api-access-znmhq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.118218 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.118175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.118259 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.118225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.219363 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.219334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.219490 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.219392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.219490 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.219432 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/fca513d1-6510-49d1-b523-740366056700-kube-api-access-znmhq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.219708 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.219686 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.219776 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.219715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.228990 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.228967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/fca513d1-6510-49d1-b523-740366056700-kube-api-access-znmhq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.343648 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.343541 2565 generic.go:356] "Generic (PLEG): container finished" podID="e11f6777-0521-46ea-aac2-47445ec99495" containerID="fbd6c1a8f42342de13bacfdbc761aec62266fd059ef2e6ab4192848cd68e45c4" exitCode=0 Jul 07 07:06:19.343648 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.343630 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" event={"ID":"e11f6777-0521-46ea-aac2-47445ec99495","Type":"ContainerDied","Data":"fbd6c1a8f42342de13bacfdbc761aec62266fd059ef2e6ab4192848cd68e45c4"} Jul 07 07:06:19.345073 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.345050 2565 generic.go:356] "Generic (PLEG): container finished" podID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerID="e6a40be05a7938cb624a91d8922447d49071871b9b66aef9e948449974229c7c" exitCode=0 Jul 07 07:06:19.345182 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.345132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" event={"ID":"f78957d9-8c58-4f95-8bfd-5a8013ce7381","Type":"ContainerDied","Data":"e6a40be05a7938cb624a91d8922447d49071871b9b66aef9e948449974229c7c"} Jul 07 07:06:19.345182 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.345178 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" event={"ID":"f78957d9-8c58-4f95-8bfd-5a8013ce7381","Type":"ContainerStarted","Data":"78192c6035c1526ddc45e8f1e6814dc1b1ef7db09f9f35f29fbbcc8de5576302"} Jul 07 07:06:19.345504 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.345487 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:19.346790 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.346772 2565 generic.go:356] "Generic (PLEG): container finished" podID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerID="48450e8a8830141c346856780f0c22f0f49bb285bb307b2ca53f8f461e69a35e" exitCode=0 Jul 07 07:06:19.346887 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.346802 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" event={"ID":"7c9434e0-97b8-49a2-a87c-89bd5ef032ae","Type":"ContainerDied","Data":"48450e8a8830141c346856780f0c22f0f49bb285bb307b2ca53f8f461e69a35e"} Jul 07 07:06:19.346887 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.346837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" event={"ID":"7c9434e0-97b8-49a2-a87c-89bd5ef032ae","Type":"ContainerStarted","Data":"e2c571393deeb211788e28728b2e72f9c3b89f5a0940da74ff921d78fc60aa19"} Jul 07 07:06:19.494114 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:19.494088 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7"] Jul 07 07:06:19.496237 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:19.496209 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca513d1_6510_49d1_b523_740366056700.slice/crio-441d716ff655bd08ed42cc1f2dbc229c5701c7f0872a1389b50ff4fa14895f97 WatchSource:0}: Error finding container 441d716ff655bd08ed42cc1f2dbc229c5701c7f0872a1389b50ff4fa14895f97: Status 404 returned error can't find the container with id 441d716ff655bd08ed42cc1f2dbc229c5701c7f0872a1389b50ff4fa14895f97 Jul 07 07:06:20.354798 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:20.354764 2565 generic.go:356] "Generic (PLEG): container finished" podID="e11f6777-0521-46ea-aac2-47445ec99495" containerID="f4acc12688ede9ba7dcb85a47ecdae8e0caf0d3d5aeb7efdcda5e66b4d76dba8" exitCode=0 Jul 07 07:06:20.355231 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:20.354850 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" event={"ID":"e11f6777-0521-46ea-aac2-47445ec99495","Type":"ContainerDied","Data":"f4acc12688ede9ba7dcb85a47ecdae8e0caf0d3d5aeb7efdcda5e66b4d76dba8"} Jul 07 07:06:20.356319 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:20.356291 2565 generic.go:356] "Generic (PLEG): container finished" podID="fca513d1-6510-49d1-b523-740366056700" containerID="fdd8c9368eabfbd2ccc97eab0cd033fe98a89c0c585f8e2abefbd334b072faf0" exitCode=0 Jul 07 07:06:20.356441 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:20.356373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" event={"ID":"fca513d1-6510-49d1-b523-740366056700","Type":"ContainerDied","Data":"fdd8c9368eabfbd2ccc97eab0cd033fe98a89c0c585f8e2abefbd334b072faf0"} Jul 07 07:06:20.356441 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:20.356409 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" event={"ID":"fca513d1-6510-49d1-b523-740366056700","Type":"ContainerStarted","Data":"441d716ff655bd08ed42cc1f2dbc229c5701c7f0872a1389b50ff4fa14895f97"} Jul 07 07:06:21.363376 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.363339 2565 generic.go:356] "Generic (PLEG): container finished" podID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerID="68ccddca5e10bb37dc0394af6effa3b9221edfd3523dfe9616b648a942455eb8" exitCode=0 Jul 07 07:06:21.363808 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.363427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" event={"ID":"7c9434e0-97b8-49a2-a87c-89bd5ef032ae","Type":"ContainerDied","Data":"68ccddca5e10bb37dc0394af6effa3b9221edfd3523dfe9616b648a942455eb8"} Jul 07 07:06:21.365374 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.365353 2565 generic.go:356] "Generic (PLEG): container finished" podID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerID="852f368354fc5024ac928f39efc80dbe5095a8261abae401d89245699f42efdf" exitCode=0 Jul 07 07:06:21.365472 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.365432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" event={"ID":"f78957d9-8c58-4f95-8bfd-5a8013ce7381","Type":"ContainerDied","Data":"852f368354fc5024ac928f39efc80dbe5095a8261abae401d89245699f42efdf"} Jul 07 07:06:21.367521 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.367497 2565 generic.go:356] "Generic (PLEG): container finished" podID="fca513d1-6510-49d1-b523-740366056700" containerID="9d353655d3163c6a750bd61758ed27a03c2ecb14e03cdac4c38f0aac9699ead0" exitCode=0 Jul 07 07:06:21.367640 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.367563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" event={"ID":"fca513d1-6510-49d1-b523-740366056700","Type":"ContainerDied","Data":"9d353655d3163c6a750bd61758ed27a03c2ecb14e03cdac4c38f0aac9699ead0"} Jul 07 07:06:21.523747 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.523710 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:21.648421 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.648379 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-bundle\") pod \"e11f6777-0521-46ea-aac2-47445ec99495\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " Jul 07 07:06:21.648571 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.648456 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-util\") pod \"e11f6777-0521-46ea-aac2-47445ec99495\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " Jul 07 07:06:21.648571 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.648505 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmqmh\" (UniqueName: \"kubernetes.io/projected/e11f6777-0521-46ea-aac2-47445ec99495-kube-api-access-mmqmh\") pod \"e11f6777-0521-46ea-aac2-47445ec99495\" (UID: \"e11f6777-0521-46ea-aac2-47445ec99495\") " Jul 07 07:06:21.648929 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.648899 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-bundle" (OuterVolumeSpecName: "bundle") pod "e11f6777-0521-46ea-aac2-47445ec99495" (UID: "e11f6777-0521-46ea-aac2-47445ec99495"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:21.650593 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.650553 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e11f6777-0521-46ea-aac2-47445ec99495-kube-api-access-mmqmh" (OuterVolumeSpecName: "kube-api-access-mmqmh") pod "e11f6777-0521-46ea-aac2-47445ec99495" (UID: "e11f6777-0521-46ea-aac2-47445ec99495"). InnerVolumeSpecName "kube-api-access-mmqmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:06:21.654349 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.654324 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-util" (OuterVolumeSpecName: "util") pod "e11f6777-0521-46ea-aac2-47445ec99495" (UID: "e11f6777-0521-46ea-aac2-47445ec99495"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:21.749370 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.749273 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:21.749370 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.749304 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e11f6777-0521-46ea-aac2-47445ec99495-util\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:21.749370 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:21.749313 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmqmh\" (UniqueName: \"kubernetes.io/projected/e11f6777-0521-46ea-aac2-47445ec99495-kube-api-access-mmqmh\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:22.387786 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.387755 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" Jul 07 07:06:22.388206 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.387752 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r" event={"ID":"e11f6777-0521-46ea-aac2-47445ec99495","Type":"ContainerDied","Data":"c2fe84fce4c8e23e30a8664d76851b7814645d49b1b90691ae736c830c2ac98f"} Jul 07 07:06:22.388206 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.387875 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2fe84fce4c8e23e30a8664d76851b7814645d49b1b90691ae736c830c2ac98f" Jul 07 07:06:22.389705 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.389679 2565 generic.go:356] "Generic (PLEG): container finished" podID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerID="737afaf20f7f89f4c0f618c1a83272896ac44c3b7a84deb5a46db129ab71e169" exitCode=0 Jul 07 07:06:22.389808 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.389767 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" event={"ID":"f78957d9-8c58-4f95-8bfd-5a8013ce7381","Type":"ContainerDied","Data":"737afaf20f7f89f4c0f618c1a83272896ac44c3b7a84deb5a46db129ab71e169"} Jul 07 07:06:22.391668 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.391645 2565 generic.go:356] "Generic (PLEG): container finished" podID="fca513d1-6510-49d1-b523-740366056700" containerID="aacfa9545fd0b22e6b7a3751c1b8a8e0a3c6c733a903e9e2b0d67bce659dffab" exitCode=0 Jul 07 07:06:22.391763 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.391722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" event={"ID":"fca513d1-6510-49d1-b523-740366056700","Type":"ContainerDied","Data":"aacfa9545fd0b22e6b7a3751c1b8a8e0a3c6c733a903e9e2b0d67bce659dffab"} Jul 07 07:06:22.393809 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.393783 2565 generic.go:356] "Generic (PLEG): container finished" podID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerID="f90f831845c3fad66250c53e1f8cf29af95dd2d8d7b11fcbcf504839e823a180" exitCode=0 Jul 07 07:06:22.393894 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:22.393822 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" event={"ID":"7c9434e0-97b8-49a2-a87c-89bd5ef032ae","Type":"ContainerDied","Data":"f90f831845c3fad66250c53e1f8cf29af95dd2d8d7b11fcbcf504839e823a180"} Jul 07 07:06:23.544965 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.544936 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:23.573853 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.573828 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:23.597172 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.597146 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:23.668127 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.668031 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-util\") pod \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " Jul 07 07:06:23.668127 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.668127 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4kkt\" (UniqueName: \"kubernetes.io/projected/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-kube-api-access-n4kkt\") pod \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " Jul 07 07:06:23.668366 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.668165 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-bundle\") pod \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\" (UID: \"7c9434e0-97b8-49a2-a87c-89bd5ef032ae\") " Jul 07 07:06:23.668672 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.668648 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-bundle" (OuterVolumeSpecName: "bundle") pod "7c9434e0-97b8-49a2-a87c-89bd5ef032ae" (UID: "7c9434e0-97b8-49a2-a87c-89bd5ef032ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:23.670196 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.670174 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-kube-api-access-n4kkt" (OuterVolumeSpecName: "kube-api-access-n4kkt") pod "7c9434e0-97b8-49a2-a87c-89bd5ef032ae" (UID: "7c9434e0-97b8-49a2-a87c-89bd5ef032ae"). InnerVolumeSpecName "kube-api-access-n4kkt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:06:23.673615 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.673573 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-util" (OuterVolumeSpecName: "util") pod "7c9434e0-97b8-49a2-a87c-89bd5ef032ae" (UID: "7c9434e0-97b8-49a2-a87c-89bd5ef032ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:23.769139 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769100 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-util\") pod \"fca513d1-6510-49d1-b523-740366056700\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " Jul 07 07:06:23.769139 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769145 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-bundle\") pod \"fca513d1-6510-49d1-b523-740366056700\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " Jul 07 07:06:23.769390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769226 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/fca513d1-6510-49d1-b523-740366056700-kube-api-access-znmhq\") pod \"fca513d1-6510-49d1-b523-740366056700\" (UID: \"fca513d1-6510-49d1-b523-740366056700\") " Jul 07 07:06:23.769390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769264 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-util\") pod \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " Jul 07 07:06:23.769390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769300 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-bundle\") pod \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " Jul 07 07:06:23.769390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769334 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxx25\" (UniqueName: \"kubernetes.io/projected/f78957d9-8c58-4f95-8bfd-5a8013ce7381-kube-api-access-wxx25\") pod \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\" (UID: \"f78957d9-8c58-4f95-8bfd-5a8013ce7381\") " Jul 07 07:06:23.769663 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769647 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-util\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:23.769744 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769668 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4kkt\" (UniqueName: \"kubernetes.io/projected/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-kube-api-access-n4kkt\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:23.769744 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769682 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c9434e0-97b8-49a2-a87c-89bd5ef032ae-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:23.769949 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769913 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-bundle" (OuterVolumeSpecName: "bundle") pod "f78957d9-8c58-4f95-8bfd-5a8013ce7381" (UID: "f78957d9-8c58-4f95-8bfd-5a8013ce7381"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:23.770013 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.769930 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-bundle" (OuterVolumeSpecName: "bundle") pod "fca513d1-6510-49d1-b523-740366056700" (UID: "fca513d1-6510-49d1-b523-740366056700"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:23.771880 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.771854 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca513d1-6510-49d1-b523-740366056700-kube-api-access-znmhq" (OuterVolumeSpecName: "kube-api-access-znmhq") pod "fca513d1-6510-49d1-b523-740366056700" (UID: "fca513d1-6510-49d1-b523-740366056700"). InnerVolumeSpecName "kube-api-access-znmhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:06:23.771976 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.771900 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78957d9-8c58-4f95-8bfd-5a8013ce7381-kube-api-access-wxx25" (OuterVolumeSpecName: "kube-api-access-wxx25") pod "f78957d9-8c58-4f95-8bfd-5a8013ce7381" (UID: "f78957d9-8c58-4f95-8bfd-5a8013ce7381"). InnerVolumeSpecName "kube-api-access-wxx25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:06:23.775997 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.775958 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-util" (OuterVolumeSpecName: "util") pod "fca513d1-6510-49d1-b523-740366056700" (UID: "fca513d1-6510-49d1-b523-740366056700"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:23.776070 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.776004 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-util" (OuterVolumeSpecName: "util") pod "f78957d9-8c58-4f95-8bfd-5a8013ce7381" (UID: "f78957d9-8c58-4f95-8bfd-5a8013ce7381"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:23.870647 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.870615 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-util\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:23.870647 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.870641 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78957d9-8c58-4f95-8bfd-5a8013ce7381-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:23.870647 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.870651 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxx25\" (UniqueName: \"kubernetes.io/projected/f78957d9-8c58-4f95-8bfd-5a8013ce7381-kube-api-access-wxx25\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:23.870858 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.870661 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-util\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:23.870858 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.870670 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca513d1-6510-49d1-b523-740366056700-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:23.870858 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:23.870678 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znmhq\" (UniqueName: \"kubernetes.io/projected/fca513d1-6510-49d1-b523-740366056700-kube-api-access-znmhq\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:24.405383 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.405354 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" Jul 07 07:06:24.405383 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.405375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm" event={"ID":"7c9434e0-97b8-49a2-a87c-89bd5ef032ae","Type":"ContainerDied","Data":"e2c571393deeb211788e28728b2e72f9c3b89f5a0940da74ff921d78fc60aa19"} Jul 07 07:06:24.405640 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.405424 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2c571393deeb211788e28728b2e72f9c3b89f5a0940da74ff921d78fc60aa19" Jul 07 07:06:24.407303 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.407279 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" Jul 07 07:06:24.407303 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.407296 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76" event={"ID":"f78957d9-8c58-4f95-8bfd-5a8013ce7381","Type":"ContainerDied","Data":"78192c6035c1526ddc45e8f1e6814dc1b1ef7db09f9f35f29fbbcc8de5576302"} Jul 07 07:06:24.407476 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.407340 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78192c6035c1526ddc45e8f1e6814dc1b1ef7db09f9f35f29fbbcc8de5576302" Jul 07 07:06:24.409290 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.409269 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" event={"ID":"fca513d1-6510-49d1-b523-740366056700","Type":"ContainerDied","Data":"441d716ff655bd08ed42cc1f2dbc229c5701c7f0872a1389b50ff4fa14895f97"} Jul 07 07:06:24.409290 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.409286 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7" Jul 07 07:06:24.409433 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:24.409306 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="441d716ff655bd08ed42cc1f2dbc229c5701c7f0872a1389b50ff4fa14895f97" Jul 07 07:06:33.712519 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712467 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr"] Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712857 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca513d1-6510-49d1-b523-740366056700" containerName="pull" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712868 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca513d1-6510-49d1-b523-740366056700" containerName="pull" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712882 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerName="pull" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712887 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerName="pull" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712894 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca513d1-6510-49d1-b523-740366056700" containerName="extract" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712899 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca513d1-6510-49d1-b523-740366056700" containerName="extract" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712910 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e11f6777-0521-46ea-aac2-47445ec99495" containerName="util" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712915 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e11f6777-0521-46ea-aac2-47445ec99495" containerName="util" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712921 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerName="pull" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712926 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerName="pull" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712932 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerName="extract" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712937 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerName="extract" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712943 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e11f6777-0521-46ea-aac2-47445ec99495" containerName="pull" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712948 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e11f6777-0521-46ea-aac2-47445ec99495" containerName="pull" Jul 07 07:06:33.712944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712956 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca513d1-6510-49d1-b523-740366056700" containerName="util" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712961 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca513d1-6510-49d1-b523-740366056700" containerName="util" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712971 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerName="util" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712976 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerName="util" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712981 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerName="util" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712986 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerName="util" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712993 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e11f6777-0521-46ea-aac2-47445ec99495" containerName="extract" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.712999 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e11f6777-0521-46ea-aac2-47445ec99495" containerName="extract" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.713005 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerName="extract" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.713010 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerName="extract" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.713067 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9434e0-97b8-49a2-a87c-89bd5ef032ae" containerName="extract" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.713074 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78957d9-8c58-4f95-8bfd-5a8013ce7381" containerName="extract" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.713080 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e11f6777-0521-46ea-aac2-47445ec99495" containerName="extract" Jul 07 07:06:33.713387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.713086 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca513d1-6510-49d1-b523-740366056700" containerName="extract" Jul 07 07:06:33.717444 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.717427 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" Jul 07 07:06:33.720626 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.720602 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cmkwl\"" Jul 07 07:06:33.721096 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.721080 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 07:06:33.728318 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.728297 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr"] Jul 07 07:06:33.751324 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.751291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pwmt\" (UniqueName: \"kubernetes.io/projected/ea79a5d9-92a0-44d6-a1ac-1e5251f50df5-kube-api-access-8pwmt\") pod \"dns-operator-controller-manager-864dd78c4c-s9qdr\" (UID: \"ea79a5d9-92a0-44d6-a1ac-1e5251f50df5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" Jul 07 07:06:33.852815 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.852772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pwmt\" (UniqueName: \"kubernetes.io/projected/ea79a5d9-92a0-44d6-a1ac-1e5251f50df5-kube-api-access-8pwmt\") pod \"dns-operator-controller-manager-864dd78c4c-s9qdr\" (UID: \"ea79a5d9-92a0-44d6-a1ac-1e5251f50df5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" Jul 07 07:06:33.866822 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:33.866785 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pwmt\" (UniqueName: \"kubernetes.io/projected/ea79a5d9-92a0-44d6-a1ac-1e5251f50df5-kube-api-access-8pwmt\") pod \"dns-operator-controller-manager-864dd78c4c-s9qdr\" (UID: \"ea79a5d9-92a0-44d6-a1ac-1e5251f50df5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" Jul 07 07:06:34.028614 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:34.028490 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" Jul 07 07:06:34.169805 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:34.169779 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr"] Jul 07 07:06:34.171709 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:34.171680 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea79a5d9_92a0_44d6_a1ac_1e5251f50df5.slice/crio-a3d2242dec718ddd18e136b3ce42f76437b0c2636b2338a65f5112a590dfb704 WatchSource:0}: Error finding container a3d2242dec718ddd18e136b3ce42f76437b0c2636b2338a65f5112a590dfb704: Status 404 returned error can't find the container with id a3d2242dec718ddd18e136b3ce42f76437b0c2636b2338a65f5112a590dfb704 Jul 07 07:06:34.465160 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:34.465125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" event={"ID":"ea79a5d9-92a0-44d6-a1ac-1e5251f50df5","Type":"ContainerStarted","Data":"a3d2242dec718ddd18e136b3ce42f76437b0c2636b2338a65f5112a590dfb704"} Jul 07 07:06:37.483346 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:37.483304 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" event={"ID":"ea79a5d9-92a0-44d6-a1ac-1e5251f50df5","Type":"ContainerStarted","Data":"2916a3de505226ec0b384b31f6bdc4383ecf6f780753faee896baa80ca169116"} Jul 07 07:06:37.483840 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:37.483372 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" Jul 07 07:06:37.505367 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:37.505304 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" podStartSLOduration=1.6768593040000002 podStartE2EDuration="4.505287271s" totalImagesPullingTime="2.828427967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:06:37.505102768 +0000 UTC m=+470.930316037" watchObservedRunningTime="2026-07-07 07:06:37.505287271 +0000 UTC m=+470.930500539" Jul 07 07:06:39.033243 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.033204 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg"] Jul 07 07:06:39.041821 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.041796 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:39.044503 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.044481 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4thjq\"" Jul 07 07:06:39.052217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.052194 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg"] Jul 07 07:06:39.103776 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.103742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7d98897-39ce-47da-8cf0-3231682e2992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" (UID: \"b7d98897-39ce-47da-8cf0-3231682e2992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:39.103776 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.103778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7t2v\" (UniqueName: \"kubernetes.io/projected/b7d98897-39ce-47da-8cf0-3231682e2992-kube-api-access-w7t2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" (UID: \"b7d98897-39ce-47da-8cf0-3231682e2992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:39.205077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.205038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7d98897-39ce-47da-8cf0-3231682e2992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" (UID: \"b7d98897-39ce-47da-8cf0-3231682e2992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:39.205077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.205081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7t2v\" (UniqueName: \"kubernetes.io/projected/b7d98897-39ce-47da-8cf0-3231682e2992-kube-api-access-w7t2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" (UID: \"b7d98897-39ce-47da-8cf0-3231682e2992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:39.205506 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.205480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7d98897-39ce-47da-8cf0-3231682e2992-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" (UID: \"b7d98897-39ce-47da-8cf0-3231682e2992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:39.226792 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.226760 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7t2v\" (UniqueName: \"kubernetes.io/projected/b7d98897-39ce-47da-8cf0-3231682e2992-kube-api-access-w7t2v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" (UID: \"b7d98897-39ce-47da-8cf0-3231682e2992\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:39.353076 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.353039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:39.498569 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:39.498548 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg"] Jul 07 07:06:39.501150 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:39.501122 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d98897_39ce_47da_8cf0_3231682e2992.slice/crio-62d77dcc6298bb141cbcf12b72c54c4357580de25fa2e72e972bfc67837c6802 WatchSource:0}: Error finding container 62d77dcc6298bb141cbcf12b72c54c4357580de25fa2e72e972bfc67837c6802: Status 404 returned error can't find the container with id 62d77dcc6298bb141cbcf12b72c54c4357580de25fa2e72e972bfc67837c6802 Jul 07 07:06:40.500143 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:40.500108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" event={"ID":"b7d98897-39ce-47da-8cf0-3231682e2992","Type":"ContainerStarted","Data":"62d77dcc6298bb141cbcf12b72c54c4357580de25fa2e72e972bfc67837c6802"} Jul 07 07:06:46.543540 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:46.543504 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" event={"ID":"b7d98897-39ce-47da-8cf0-3231682e2992","Type":"ContainerStarted","Data":"bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307"} Jul 07 07:06:46.543950 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:46.543599 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:46.570032 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:46.569976 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" podStartSLOduration=1.489842828 podStartE2EDuration="7.569960688s" totalImagesPullingTime="6.08011786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:06:46.566487922 +0000 UTC m=+479.991701191" watchObservedRunningTime="2026-07-07 07:06:46.569960688 +0000 UTC m=+479.995174005" Jul 07 07:06:48.362278 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.362247 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4"] Jul 07 07:06:48.367304 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.367280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.369795 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.369764 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 07:06:48.369795 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.369783 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dbd4w\"" Jul 07 07:06:48.370043 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.370030 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 07:06:48.376166 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.376140 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4"] Jul 07 07:06:48.490809 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.490771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42f35957-f947-4b61-8155-55fa83de2946-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.490809 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.490807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz6b6\" (UniqueName: \"kubernetes.io/projected/42f35957-f947-4b61-8155-55fa83de2946-kube-api-access-hz6b6\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.491019 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.490920 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42f35957-f947-4b61-8155-55fa83de2946-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.491236 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.491218 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s9qdr" Jul 07 07:06:48.591887 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.591851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42f35957-f947-4b61-8155-55fa83de2946-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.592083 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.591909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42f35957-f947-4b61-8155-55fa83de2946-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.592083 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.591934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz6b6\" (UniqueName: \"kubernetes.io/projected/42f35957-f947-4b61-8155-55fa83de2946-kube-api-access-hz6b6\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.592681 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.592656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42f35957-f947-4b61-8155-55fa83de2946-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.594262 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.594244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42f35957-f947-4b61-8155-55fa83de2946-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.602030 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.602005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz6b6\" (UniqueName: \"kubernetes.io/projected/42f35957-f947-4b61-8155-55fa83de2946-kube-api-access-hz6b6\") pod \"kuadrant-console-plugin-66b5774985-t8sj4\" (UID: \"42f35957-f947-4b61-8155-55fa83de2946\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.678447 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.678359 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" Jul 07 07:06:48.814946 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:48.814921 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4"] Jul 07 07:06:48.816753 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:06:48.816726 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42f35957_f947_4b61_8155_55fa83de2946.slice/crio-7b362ed14afc3afc9f48a4c98ac331c5442e3a00712e1dcbf1f1a3167b4ba124 WatchSource:0}: Error finding container 7b362ed14afc3afc9f48a4c98ac331c5442e3a00712e1dcbf1f1a3167b4ba124: Status 404 returned error can't find the container with id 7b362ed14afc3afc9f48a4c98ac331c5442e3a00712e1dcbf1f1a3167b4ba124 Jul 07 07:06:49.561003 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:49.560970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" event={"ID":"42f35957-f947-4b61-8155-55fa83de2946","Type":"ContainerStarted","Data":"7b362ed14afc3afc9f48a4c98ac331c5442e3a00712e1dcbf1f1a3167b4ba124"} Jul 07 07:06:57.551542 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:57.551505 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:59.135968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.135935 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz"] Jul 07 07:06:59.143294 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.143272 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.161188 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.161154 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz"] Jul 07 07:06:59.288327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.288291 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz"] Jul 07 07:06:59.288723 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.288671 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-fbs2p], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" podUID="f773ee54-ecd4-43eb-95ff-e200dbc08a1d" Jul 07 07:06:59.298652 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.298627 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz"] Jul 07 07:06:59.303702 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.303666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbs2p\" (UniqueName: \"kubernetes.io/projected/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-kube-api-access-fbs2p\") pod \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" (UID: \"f773ee54-ecd4-43eb-95ff-e200dbc08a1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.303839 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.303726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" (UID: \"f773ee54-ecd4-43eb-95ff-e200dbc08a1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.314703 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.314671 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg"] Jul 07 07:06:59.315089 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.314904 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" containerName="manager" containerID="cri-o://bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307" gracePeriod=2 Jul 07 07:06:59.317804 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.317782 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc"] Jul 07 07:06:59.324680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.324561 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.326328 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.326302 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg"] Jul 07 07:06:59.328550 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.328453 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:59.333064 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.332387 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc"] Jul 07 07:06:59.349515 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.349482 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2"] Jul 07 07:06:59.350034 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.350015 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" containerName="manager" Jul 07 07:06:59.350034 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.350036 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" containerName="manager" Jul 07 07:06:59.350214 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.350152 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" containerName="manager" Jul 07 07:06:59.353797 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.353773 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:06:59.367888 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.367854 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc"] Jul 07 07:06:59.371648 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.371610 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2"] Jul 07 07:06:59.390762 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.390685 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rwlgd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" podUID="7347c90e-216e-4f8b-b99b-36dc357a3197" Jul 07 07:06:59.391044 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.391011 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:59.404855 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.404827 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbs2p\" (UniqueName: \"kubernetes.io/projected/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-kube-api-access-fbs2p\") pod \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" (UID: \"f773ee54-ecd4-43eb-95ff-e200dbc08a1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.405010 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.404877 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7347c90e-216e-4f8b-b99b-36dc357a3197-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ztkkc\" (UID: \"7347c90e-216e-4f8b-b99b-36dc357a3197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.405010 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.404928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" (UID: \"f773ee54-ecd4-43eb-95ff-e200dbc08a1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.405109 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.405048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwlgd\" (UniqueName: \"kubernetes.io/projected/7347c90e-216e-4f8b-b99b-36dc357a3197-kube-api-access-rwlgd\") pod \"kuadrant-operator-controller-manager-55467d9f7-ztkkc\" (UID: \"7347c90e-216e-4f8b-b99b-36dc357a3197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.405244 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.405222 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" (UID: \"f773ee54-ecd4-43eb-95ff-e200dbc08a1d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.422486 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.422454 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc"] Jul 07 07:06:59.427597 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.427566 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fbs2p for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-zm8dz" not found Jul 07 07:06:59.427740 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.427659 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:06:59.427740 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.427660 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-kube-api-access-fbs2p podName:f773ee54-ecd4-43eb-95ff-e200dbc08a1d nodeName:}" failed. No retries permitted until 2026-07-07 07:06:59.927637205 +0000 UTC m=+493.352850476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fbs2p" (UniqueName: "kubernetes.io/projected/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-kube-api-access-fbs2p") pod "kuadrant-operator-controller-manager-55467d9f7-zm8dz" (UID: "f773ee54-ecd4-43eb-95ff-e200dbc08a1d") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-zm8dz" not found Jul 07 07:06:59.431188 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.431150 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:59.461487 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.461450 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc"] Jul 07 07:06:59.506740 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.506704 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/153a9ad3-8468-45e0-8385-3311ea819377-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgwm2\" (UID: \"153a9ad3-8468-45e0-8385-3311ea819377\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:06:59.506919 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.506747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjw4g\" (UniqueName: \"kubernetes.io/projected/153a9ad3-8468-45e0-8385-3311ea819377-kube-api-access-pjw4g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgwm2\" (UID: \"153a9ad3-8468-45e0-8385-3311ea819377\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:06:59.506919 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.506895 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwlgd\" (UniqueName: \"kubernetes.io/projected/7347c90e-216e-4f8b-b99b-36dc357a3197-kube-api-access-rwlgd\") pod \"kuadrant-operator-controller-manager-55467d9f7-ztkkc\" (UID: \"7347c90e-216e-4f8b-b99b-36dc357a3197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.507040 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.506962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msjmg\" (UniqueName: \"kubernetes.io/projected/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-kube-api-access-msjmg\") pod \"kuadrant-operator-controller-manager-86878c769f-2gdxc\" (UID: \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:06:59.507040 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.506996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2gdxc\" (UID: \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:06:59.507040 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.507023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7347c90e-216e-4f8b-b99b-36dc357a3197-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ztkkc\" (UID: \"7347c90e-216e-4f8b-b99b-36dc357a3197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.507409 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.507393 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7347c90e-216e-4f8b-b99b-36dc357a3197-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ztkkc\" (UID: \"7347c90e-216e-4f8b-b99b-36dc357a3197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.518198 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.518175 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwlgd\" (UniqueName: \"kubernetes.io/projected/7347c90e-216e-4f8b-b99b-36dc357a3197-kube-api-access-rwlgd\") pod \"kuadrant-operator-controller-manager-55467d9f7-ztkkc\" (UID: \"7347c90e-216e-4f8b-b99b-36dc357a3197\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.607975 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.607936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjmg\" (UniqueName: \"kubernetes.io/projected/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-kube-api-access-msjmg\") pod \"kuadrant-operator-controller-manager-86878c769f-2gdxc\" (UID: \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:06:59.608172 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.607987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2gdxc\" (UID: \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:06:59.608172 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.608078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/153a9ad3-8468-45e0-8385-3311ea819377-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgwm2\" (UID: \"153a9ad3-8468-45e0-8385-3311ea819377\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:06:59.608172 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.608103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjw4g\" (UniqueName: \"kubernetes.io/projected/153a9ad3-8468-45e0-8385-3311ea819377-kube-api-access-pjw4g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgwm2\" (UID: \"153a9ad3-8468-45e0-8385-3311ea819377\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:06:59.608534 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.608511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/153a9ad3-8468-45e0-8385-3311ea819377-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgwm2\" (UID: \"153a9ad3-8468-45e0-8385-3311ea819377\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:06:59.608606 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.608511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2gdxc\" (UID: \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:06:59.619517 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.619478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msjmg\" (UniqueName: \"kubernetes.io/projected/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-kube-api-access-msjmg\") pod \"kuadrant-operator-controller-manager-86878c769f-2gdxc\" (UID: \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:06:59.621960 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.621938 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjw4g\" (UniqueName: \"kubernetes.io/projected/153a9ad3-8468-45e0-8385-3311ea819377-kube-api-access-pjw4g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bgwm2\" (UID: \"153a9ad3-8468-45e0-8385-3311ea819377\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:06:59.633061 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.633035 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.633213 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.633037 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.635358 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.635328 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:59.637509 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.637479 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="f773ee54-ecd4-43eb-95ff-e200dbc08a1d" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.646495 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.646441 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:06:59.648851 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.648829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.660158 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.660102 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:06:59.662188 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:06:59.662154 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="f773ee54-ecd4-43eb-95ff-e200dbc08a1d" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:06:59.698951 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.698912 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:06:59.739453 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.739409 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:06:59.810105 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.810065 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7347c90e-216e-4f8b-b99b-36dc357a3197-extensions-socket-volume\") pod \"7347c90e-216e-4f8b-b99b-36dc357a3197\" (UID: \"7347c90e-216e-4f8b-b99b-36dc357a3197\") " Jul 07 07:06:59.810300 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.810122 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-extensions-socket-volume\") pod \"f773ee54-ecd4-43eb-95ff-e200dbc08a1d\" (UID: \"f773ee54-ecd4-43eb-95ff-e200dbc08a1d\") " Jul 07 07:06:59.810300 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.810152 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwlgd\" (UniqueName: \"kubernetes.io/projected/7347c90e-216e-4f8b-b99b-36dc357a3197-kube-api-access-rwlgd\") pod \"7347c90e-216e-4f8b-b99b-36dc357a3197\" (UID: \"7347c90e-216e-4f8b-b99b-36dc357a3197\") " Jul 07 07:06:59.810426 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.810403 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f773ee54-ecd4-43eb-95ff-e200dbc08a1d" (UID: "f773ee54-ecd4-43eb-95ff-e200dbc08a1d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:59.810476 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.810403 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7347c90e-216e-4f8b-b99b-36dc357a3197-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7347c90e-216e-4f8b-b99b-36dc357a3197" (UID: "7347c90e-216e-4f8b-b99b-36dc357a3197"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:06:59.810554 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.810537 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbs2p\" (UniqueName: \"kubernetes.io/projected/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-kube-api-access-fbs2p\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:59.810648 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.810559 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7347c90e-216e-4f8b-b99b-36dc357a3197-extensions-socket-volume\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:59.810648 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.810574 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f773ee54-ecd4-43eb-95ff-e200dbc08a1d-extensions-socket-volume\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:06:59.812643 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.812605 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7347c90e-216e-4f8b-b99b-36dc357a3197-kube-api-access-rwlgd" (OuterVolumeSpecName: "kube-api-access-rwlgd") pod "7347c90e-216e-4f8b-b99b-36dc357a3197" (UID: "7347c90e-216e-4f8b-b99b-36dc357a3197"). InnerVolumeSpecName "kube-api-access-rwlgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:06:59.911987 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:06:59.911899 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwlgd\" (UniqueName: \"kubernetes.io/projected/7347c90e-216e-4f8b-b99b-36dc357a3197-kube-api-access-rwlgd\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:00.638765 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:00.638733 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc" Jul 07 07:07:00.639251 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:00.638733 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:07:00.641811 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:00.641779 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:07:00.644083 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:00.644048 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="f773ee54-ecd4-43eb-95ff-e200dbc08a1d" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:07:00.692328 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:00.692287 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc"] Jul 07 07:07:00.696723 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:00.696688 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:07:00.698623 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:00.698568 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zm8dz\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="f773ee54-ecd4-43eb-95ff-e200dbc08a1d" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zm8dz" Jul 07 07:07:00.699142 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:00.699098 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ztkkc"] Jul 07 07:07:01.134904 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:01.134867 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7347c90e-216e-4f8b-b99b-36dc357a3197" path="/var/lib/kubelet/pods/7347c90e-216e-4f8b-b99b-36dc357a3197/volumes" Jul 07 07:07:01.135188 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:01.135164 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f773ee54-ecd4-43eb-95ff-e200dbc08a1d" path="/var/lib/kubelet/pods/f773ee54-ecd4-43eb-95ff-e200dbc08a1d/volumes" Jul 07 07:07:13.342111 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.342018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2"] Jul 07 07:07:13.345101 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:07:13.345076 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153a9ad3_8468_45e0_8385_3311ea819377.slice/crio-e5d3d3b25e72110ede3c0d4d59c963aa15ca795891173055ad1c8d8b93c69adf WatchSource:0}: Error finding container e5d3d3b25e72110ede3c0d4d59c963aa15ca795891173055ad1c8d8b93c69adf: Status 404 returned error can't find the container with id e5d3d3b25e72110ede3c0d4d59c963aa15ca795891173055ad1c8d8b93c69adf Jul 07 07:07:13.348045 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.348025 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:07:13.349900 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:13.349876 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:07:13.361337 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.361308 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc"] Jul 07 07:07:13.363614 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:07:13.363562 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca66373_bfaa_42ee_91b1_02c1b9b1eb04.slice/crio-5214f6d4d6a1070895e23258c772e469b1c85ed80dfc1f4dd171a3375a36ed50 WatchSource:0}: Error finding container 5214f6d4d6a1070895e23258c772e469b1c85ed80dfc1f4dd171a3375a36ed50: Status 404 returned error can't find the container with id 5214f6d4d6a1070895e23258c772e469b1c85ed80dfc1f4dd171a3375a36ed50 Jul 07 07:07:13.448038 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.448004 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7d98897-39ce-47da-8cf0-3231682e2992-extensions-socket-volume\") pod \"b7d98897-39ce-47da-8cf0-3231682e2992\" (UID: \"b7d98897-39ce-47da-8cf0-3231682e2992\") " Jul 07 07:07:13.448208 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.448154 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7t2v\" (UniqueName: \"kubernetes.io/projected/b7d98897-39ce-47da-8cf0-3231682e2992-kube-api-access-w7t2v\") pod \"b7d98897-39ce-47da-8cf0-3231682e2992\" (UID: \"b7d98897-39ce-47da-8cf0-3231682e2992\") " Jul 07 07:07:13.448433 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.448410 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d98897-39ce-47da-8cf0-3231682e2992-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b7d98897-39ce-47da-8cf0-3231682e2992" (UID: "b7d98897-39ce-47da-8cf0-3231682e2992"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:07:13.450103 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.450074 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d98897-39ce-47da-8cf0-3231682e2992-kube-api-access-w7t2v" (OuterVolumeSpecName: "kube-api-access-w7t2v") pod "b7d98897-39ce-47da-8cf0-3231682e2992" (UID: "b7d98897-39ce-47da-8cf0-3231682e2992"). InnerVolumeSpecName "kube-api-access-w7t2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:07:13.549865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.549833 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7t2v\" (UniqueName: \"kubernetes.io/projected/b7d98897-39ce-47da-8cf0-3231682e2992-kube-api-access-w7t2v\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:13.549865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.549861 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7d98897-39ce-47da-8cf0-3231682e2992-extensions-socket-volume\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:13.724618 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.724515 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" event={"ID":"42f35957-f947-4b61-8155-55fa83de2946","Type":"ContainerStarted","Data":"c91e54d495c847ac7bbb0cd1bd33aac8461b7f33971754713acf8eaabe8f6ee1"} Jul 07 07:07:13.726373 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.726340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" event={"ID":"eca66373-bfaa-42ee-91b1-02c1b9b1eb04","Type":"ContainerStarted","Data":"43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11"} Jul 07 07:07:13.726514 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.726437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" event={"ID":"eca66373-bfaa-42ee-91b1-02c1b9b1eb04","Type":"ContainerStarted","Data":"5214f6d4d6a1070895e23258c772e469b1c85ed80dfc1f4dd171a3375a36ed50"} Jul 07 07:07:13.726514 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.726466 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:07:13.727809 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.727780 2565 generic.go:356] "Generic (PLEG): container finished" podID="b7d98897-39ce-47da-8cf0-3231682e2992" containerID="bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307" exitCode=0 Jul 07 07:07:13.727903 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.727826 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:07:13.727903 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.727851 2565 scope.go:117] "RemoveContainer" containerID="bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307" Jul 07 07:07:13.729820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.729793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" event={"ID":"153a9ad3-8468-45e0-8385-3311ea819377","Type":"ContainerStarted","Data":"dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc"} Jul 07 07:07:13.729923 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.729851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" event={"ID":"153a9ad3-8468-45e0-8385-3311ea819377","Type":"ContainerStarted","Data":"e5d3d3b25e72110ede3c0d4d59c963aa15ca795891173055ad1c8d8b93c69adf"} Jul 07 07:07:13.729988 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.729926 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:07:13.737733 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.737714 2565 scope.go:117] "RemoveContainer" containerID="bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307" Jul 07 07:07:13.738010 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:13.737991 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307\": container with ID starting with bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307 not found: ID does not exist" containerID="bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307" Jul 07 07:07:13.738082 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.738021 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307"} err="failed to get container status \"bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307\": rpc error: code = NotFound desc = could not find container \"bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307\": container with ID starting with bf7cf5b7005bfd6a1528612991386c76fef870ab56f78317ce4eb957227ae307 not found: ID does not exist" Jul 07 07:07:13.746956 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.746915 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t8sj4" podStartSLOduration=1.29906859 podStartE2EDuration="25.746899132s" totalImagesPullingTime="24.447830542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:07:13.745110573 +0000 UTC m=+507.170323843" watchObservedRunningTime="2026-07-07 07:07:13.746899132 +0000 UTC m=+507.172112401" Jul 07 07:07:13.747256 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:13.747229 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:07:13.749032 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:13.749010 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75gvg\" is forbidden: User \"system:node:ip-10-0-138-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-175.ec2.internal' and this object" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75gvg" Jul 07 07:07:13.771715 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.771634 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" podStartSLOduration=14.771616149 podStartE2EDuration="14.771616149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:07:13.770352232 +0000 UTC m=+507.195565502" watchObservedRunningTime="2026-07-07 07:07:13.771616149 +0000 UTC m=+507.196829485" Jul 07 07:07:13.796316 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:13.796265 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" podStartSLOduration=14.796248614 podStartE2EDuration="14.796248614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:07:13.79351338 +0000 UTC m=+507.218726717" watchObservedRunningTime="2026-07-07 07:07:13.796248614 +0000 UTC m=+507.221461942" Jul 07 07:07:15.133978 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:15.133939 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7d98897-39ce-47da-8cf0-3231682e2992" path="/var/lib/kubelet/pods/b7d98897-39ce-47da-8cf0-3231682e2992/volumes" Jul 07 07:07:20.077177 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:20.077132 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f87855f6-mj8f5"] Jul 07 07:07:24.738562 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:24.738530 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:07:24.738957 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:24.738659 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:07:24.815903 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:24.815873 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2"] Jul 07 07:07:24.816095 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:24.816072 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" podUID="153a9ad3-8468-45e0-8385-3311ea819377" containerName="manager" containerID="cri-o://dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc" gracePeriod=10 Jul 07 07:07:25.072459 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.072435 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:07:25.162876 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.162841 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/153a9ad3-8468-45e0-8385-3311ea819377-extensions-socket-volume\") pod \"153a9ad3-8468-45e0-8385-3311ea819377\" (UID: \"153a9ad3-8468-45e0-8385-3311ea819377\") " Jul 07 07:07:25.162876 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.162875 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjw4g\" (UniqueName: \"kubernetes.io/projected/153a9ad3-8468-45e0-8385-3311ea819377-kube-api-access-pjw4g\") pod \"153a9ad3-8468-45e0-8385-3311ea819377\" (UID: \"153a9ad3-8468-45e0-8385-3311ea819377\") " Jul 07 07:07:25.163284 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.163257 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/153a9ad3-8468-45e0-8385-3311ea819377-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "153a9ad3-8468-45e0-8385-3311ea819377" (UID: "153a9ad3-8468-45e0-8385-3311ea819377"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:07:25.164963 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.164937 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/153a9ad3-8468-45e0-8385-3311ea819377-kube-api-access-pjw4g" (OuterVolumeSpecName: "kube-api-access-pjw4g") pod "153a9ad3-8468-45e0-8385-3311ea819377" (UID: "153a9ad3-8468-45e0-8385-3311ea819377"). InnerVolumeSpecName "kube-api-access-pjw4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:07:25.264490 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.264451 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/153a9ad3-8468-45e0-8385-3311ea819377-extensions-socket-volume\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:25.264490 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.264483 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjw4g\" (UniqueName: \"kubernetes.io/projected/153a9ad3-8468-45e0-8385-3311ea819377-kube-api-access-pjw4g\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:25.802037 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.801999 2565 generic.go:356] "Generic (PLEG): container finished" podID="153a9ad3-8468-45e0-8385-3311ea819377" containerID="dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc" exitCode=0 Jul 07 07:07:25.802454 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.802054 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" Jul 07 07:07:25.802454 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.802086 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" event={"ID":"153a9ad3-8468-45e0-8385-3311ea819377","Type":"ContainerDied","Data":"dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc"} Jul 07 07:07:25.802454 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.802127 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2" event={"ID":"153a9ad3-8468-45e0-8385-3311ea819377","Type":"ContainerDied","Data":"e5d3d3b25e72110ede3c0d4d59c963aa15ca795891173055ad1c8d8b93c69adf"} Jul 07 07:07:25.802454 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.802148 2565 scope.go:117] "RemoveContainer" containerID="dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc" Jul 07 07:07:25.812041 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.812022 2565 scope.go:117] "RemoveContainer" containerID="dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc" Jul 07 07:07:25.812303 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:25.812283 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc\": container with ID starting with dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc not found: ID does not exist" containerID="dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc" Jul 07 07:07:25.812370 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.812310 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc"} err="failed to get container status \"dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc\": rpc error: code = NotFound desc = could not find container \"dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc\": container with ID starting with dc42b9ef8c2e2d7f3c1e11002d26c8295de0b81ba198571fc451c0666fc8d2fc not found: ID does not exist" Jul 07 07:07:25.826289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.826257 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2"] Jul 07 07:07:25.831093 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:25.831067 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bgwm2"] Jul 07 07:07:27.134379 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:27.134350 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="153a9ad3-8468-45e0-8385-3311ea819377" path="/var/lib/kubelet/pods/153a9ad3-8468-45e0-8385-3311ea819377/volumes" Jul 07 07:07:41.354896 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.354822 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd"] Jul 07 07:07:41.362554 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.362498 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="153a9ad3-8468-45e0-8385-3311ea819377" containerName="manager" Jul 07 07:07:41.362728 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.362573 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="153a9ad3-8468-45e0-8385-3311ea819377" containerName="manager" Jul 07 07:07:41.363004 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.362989 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="153a9ad3-8468-45e0-8385-3311ea819377" containerName="manager" Jul 07 07:07:41.628611 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.628517 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd"] Jul 07 07:07:41.628773 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.628649 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.631285 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.631257 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g8k2l\"" Jul 07 07:07:41.718193 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.718193 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d741e70-65e3-4375-92fb-51f48cb6e371-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.718450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.718450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.718450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.718450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.718450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.718759 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xthg\" (UniqueName: \"kubernetes.io/projected/3d741e70-65e3-4375-92fb-51f48cb6e371-kube-api-access-7xthg\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.718759 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.718529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819309 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819309 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xthg\" (UniqueName: \"kubernetes.io/projected/3d741e70-65e3-4375-92fb-51f48cb6e371-kube-api-access-7xthg\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819468 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d741e70-65e3-4375-92fb-51f48cb6e371-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819542 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819936 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819730 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819936 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819869 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.819936 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.819899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.820101 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.820032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.820398 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.820376 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d741e70-65e3-4375-92fb-51f48cb6e371-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.821800 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.821782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.822108 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.822092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.828779 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.828756 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xthg\" (UniqueName: \"kubernetes.io/projected/3d741e70-65e3-4375-92fb-51f48cb6e371-kube-api-access-7xthg\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.828858 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.828844 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d741e70-65e3-4375-92fb-51f48cb6e371-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-h26rd\" (UID: \"3d741e70-65e3-4375-92fb-51f48cb6e371\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:41.939831 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:41.939757 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:42.155314 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:42.155277 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd"] Jul 07 07:07:42.155450 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:07:42.155422 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d741e70_65e3_4375_92fb_51f48cb6e371.slice/crio-4c0e3370218394bd8854d4675d895a664c31e6d4e352b30237ab54deae22c332 WatchSource:0}: Error finding container 4c0e3370218394bd8854d4675d895a664c31e6d4e352b30237ab54deae22c332: Status 404 returned error can't find the container with id 4c0e3370218394bd8854d4675d895a664c31e6d4e352b30237ab54deae22c332 Jul 07 07:07:42.157694 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:42.157659 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:07:42.157805 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:42.157727 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:07:42.157805 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:42.157763 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:07:42.900454 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:42.900417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" event={"ID":"3d741e70-65e3-4375-92fb-51f48cb6e371","Type":"ContainerStarted","Data":"f5e9278455d9644ac97545b02bf3f9d3ffbcfc425587eb37530916434ae88d86"} Jul 07 07:07:42.900846 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:42.900469 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" event={"ID":"3d741e70-65e3-4375-92fb-51f48cb6e371","Type":"ContainerStarted","Data":"4c0e3370218394bd8854d4675d895a664c31e6d4e352b30237ab54deae22c332"} Jul 07 07:07:42.929710 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:42.929659 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" podStartSLOduration=1.929638365 podStartE2EDuration="1.929638365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:07:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:07:42.92775881 +0000 UTC m=+536.352972103" watchObservedRunningTime="2026-07-07 07:07:42.929638365 +0000 UTC m=+536.354851634" Jul 07 07:07:42.939836 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:42.939804 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:43.944874 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:43.944841 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:44.458222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.458187 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:07:44.499263 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.499228 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:07:44.499263 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.499263 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:07:44.499463 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.499335 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:44.501824 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.501788 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 07:07:44.649458 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.649414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9n8p\" (UniqueName: \"kubernetes.io/projected/e8568b92-27ed-46bb-acf0-1e142a142bd4-kube-api-access-z9n8p\") pod \"limitador-limitador-54d6d988d5-jlwlb\" (UID: \"e8568b92-27ed-46bb-acf0-1e142a142bd4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:44.649458 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.649462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e8568b92-27ed-46bb-acf0-1e142a142bd4-config-file\") pod \"limitador-limitador-54d6d988d5-jlwlb\" (UID: \"e8568b92-27ed-46bb-acf0-1e142a142bd4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:44.750007 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.749915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9n8p\" (UniqueName: \"kubernetes.io/projected/e8568b92-27ed-46bb-acf0-1e142a142bd4-kube-api-access-z9n8p\") pod \"limitador-limitador-54d6d988d5-jlwlb\" (UID: \"e8568b92-27ed-46bb-acf0-1e142a142bd4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:44.750007 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.749955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e8568b92-27ed-46bb-acf0-1e142a142bd4-config-file\") pod \"limitador-limitador-54d6d988d5-jlwlb\" (UID: \"e8568b92-27ed-46bb-acf0-1e142a142bd4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:44.750608 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.750561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e8568b92-27ed-46bb-acf0-1e142a142bd4-config-file\") pod \"limitador-limitador-54d6d988d5-jlwlb\" (UID: \"e8568b92-27ed-46bb-acf0-1e142a142bd4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:44.759075 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.759054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9n8p\" (UniqueName: \"kubernetes.io/projected/e8568b92-27ed-46bb-acf0-1e142a142bd4-kube-api-access-z9n8p\") pod \"limitador-limitador-54d6d988d5-jlwlb\" (UID: \"e8568b92-27ed-46bb-acf0-1e142a142bd4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:44.810047 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.810010 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:44.914223 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.914189 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:44.915319 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.915294 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:07:44.950627 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:44.950603 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:07:44.955672 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:07:44.955642 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8568b92_27ed_46bb_acf0_1e142a142bd4.slice/crio-d6f1564b05660ff71171ace04def620f3fd0ea4a40a11e878cb303779f37d644 WatchSource:0}: Error finding container d6f1564b05660ff71171ace04def620f3fd0ea4a40a11e878cb303779f37d644: Status 404 returned error can't find the container with id d6f1564b05660ff71171ace04def620f3fd0ea4a40a11e878cb303779f37d644 Jul 07 07:07:45.100948 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.100910 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54f87855f6-mj8f5" podUID="3fe0c864-6c5e-4d80-893b-f89f9592cfd0" containerName="console" containerID="cri-o://0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185" gracePeriod=15 Jul 07 07:07:45.168753 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.168721 2565 patch_prober.go:28] interesting pod/console-54f87855f6-mj8f5 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.26:8443/health\": dial tcp 10.133.0.26:8443: connect: connection refused" start-of-body= Jul 07 07:07:45.168905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.168766 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-54f87855f6-mj8f5" podUID="3fe0c864-6c5e-4d80-893b-f89f9592cfd0" containerName="console" probeResult="failure" output="Get \"https://10.133.0.26:8443/health\": dial tcp 10.133.0.26:8443: connect: connection refused" Jul 07 07:07:45.335651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.335626 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:07:45.458039 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.457948 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-config\") pod \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " Jul 07 07:07:45.458039 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.457989 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-trusted-ca-bundle\") pod \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " Jul 07 07:07:45.458039 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458031 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-oauth-serving-cert\") pod \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " Jul 07 07:07:45.458305 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458063 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-service-ca\") pod \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " Jul 07 07:07:45.458305 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458086 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-serving-cert\") pod \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " Jul 07 07:07:45.458305 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458115 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-oauth-config\") pod \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " Jul 07 07:07:45.458305 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458148 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjjnn\" (UniqueName: \"kubernetes.io/projected/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-kube-api-access-pjjnn\") pod \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\" (UID: \"3fe0c864-6c5e-4d80-893b-f89f9592cfd0\") " Jul 07 07:07:45.458514 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458485 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3fe0c864-6c5e-4d80-893b-f89f9592cfd0" (UID: "3fe0c864-6c5e-4d80-893b-f89f9592cfd0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:07:45.458572 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458541 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3fe0c864-6c5e-4d80-893b-f89f9592cfd0" (UID: "3fe0c864-6c5e-4d80-893b-f89f9592cfd0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:07:45.458572 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458555 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-service-ca" (OuterVolumeSpecName: "service-ca") pod "3fe0c864-6c5e-4d80-893b-f89f9592cfd0" (UID: "3fe0c864-6c5e-4d80-893b-f89f9592cfd0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:07:45.458712 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.458689 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-config" (OuterVolumeSpecName: "console-config") pod "3fe0c864-6c5e-4d80-893b-f89f9592cfd0" (UID: "3fe0c864-6c5e-4d80-893b-f89f9592cfd0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:07:45.460333 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.460311 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3fe0c864-6c5e-4d80-893b-f89f9592cfd0" (UID: "3fe0c864-6c5e-4d80-893b-f89f9592cfd0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:07:45.460333 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.460318 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-kube-api-access-pjjnn" (OuterVolumeSpecName: "kube-api-access-pjjnn") pod "3fe0c864-6c5e-4d80-893b-f89f9592cfd0" (UID: "3fe0c864-6c5e-4d80-893b-f89f9592cfd0"). InnerVolumeSpecName "kube-api-access-pjjnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:07:45.460333 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.460326 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3fe0c864-6c5e-4d80-893b-f89f9592cfd0" (UID: "3fe0c864-6c5e-4d80-893b-f89f9592cfd0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 07:07:45.559508 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.559475 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-config\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:45.559508 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.559506 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-trusted-ca-bundle\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:45.559508 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.559516 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-oauth-serving-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:45.559764 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.559525 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-service-ca\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:45.559764 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.559533 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-serving-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:45.559764 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.559541 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-console-oauth-config\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:45.559764 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.559550 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjjnn\" (UniqueName: \"kubernetes.io/projected/3fe0c864-6c5e-4d80-893b-f89f9592cfd0-kube-api-access-pjjnn\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:07:45.925739 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.925648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" event={"ID":"e8568b92-27ed-46bb-acf0-1e142a142bd4","Type":"ContainerStarted","Data":"d6f1564b05660ff71171ace04def620f3fd0ea4a40a11e878cb303779f37d644"} Jul 07 07:07:45.928513 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.927442 2565 generic.go:356] "Generic (PLEG): container finished" podID="3fe0c864-6c5e-4d80-893b-f89f9592cfd0" containerID="0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185" exitCode=0 Jul 07 07:07:45.928513 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.927510 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f87855f6-mj8f5" Jul 07 07:07:45.928513 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.927537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f87855f6-mj8f5" event={"ID":"3fe0c864-6c5e-4d80-893b-f89f9592cfd0","Type":"ContainerDied","Data":"0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185"} Jul 07 07:07:45.928513 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.927574 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f87855f6-mj8f5" event={"ID":"3fe0c864-6c5e-4d80-893b-f89f9592cfd0","Type":"ContainerDied","Data":"98bdc3d956d217de973043325887f546aede5278e06ad809068b70193a131c7a"} Jul 07 07:07:45.928513 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.927637 2565 scope.go:117] "RemoveContainer" containerID="0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185" Jul 07 07:07:45.950856 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.950815 2565 scope.go:117] "RemoveContainer" containerID="0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185" Jul 07 07:07:45.952001 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:07:45.951931 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185\": container with ID starting with 0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185 not found: ID does not exist" containerID="0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185" Jul 07 07:07:45.952001 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.951973 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185"} err="failed to get container status \"0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185\": rpc error: code = NotFound desc = could not find container \"0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185\": container with ID starting with 0691edace621dcd7d9d5090ebb2c8b7487bb11c5bbe30ffe92213b17fa180185 not found: ID does not exist" Jul 07 07:07:45.958940 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.958825 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f87855f6-mj8f5"] Jul 07 07:07:45.963166 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:45.963139 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f87855f6-mj8f5"] Jul 07 07:07:47.143699 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:47.143662 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fe0c864-6c5e-4d80-893b-f89f9592cfd0" path="/var/lib/kubelet/pods/3fe0c864-6c5e-4d80-893b-f89f9592cfd0/volumes" Jul 07 07:07:47.943527 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:47.943495 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" event={"ID":"e8568b92-27ed-46bb-acf0-1e142a142bd4","Type":"ContainerStarted","Data":"fbb8601ed5f989017bbcd228bc472734dc19e4348e56652857f3697187477fc6"} Jul 07 07:07:47.943694 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:47.943554 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:07:47.963598 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:47.963539 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" podStartSLOduration=1.048916464 podStartE2EDuration="3.963524661s" totalImagesPullingTime="2.914608197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:07:47.961544771 +0000 UTC m=+541.386758043" watchObservedRunningTime="2026-07-07 07:07:47.963524661 +0000 UTC m=+541.388737938" Jul 07 07:07:58.950608 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:07:58.950549 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-jlwlb" Jul 07 07:08:55.701260 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:08:55.701225 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:09:03.374874 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:03.374842 2565 generic.go:356] "Generic (PLEG): container finished" podID="3d741e70-65e3-4375-92fb-51f48cb6e371" containerID="f5e9278455d9644ac97545b02bf3f9d3ffbcfc425587eb37530916434ae88d86" exitCode=0 Jul 07 07:09:03.375311 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:03.374917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" event={"ID":"3d741e70-65e3-4375-92fb-51f48cb6e371","Type":"ContainerDied","Data":"f5e9278455d9644ac97545b02bf3f9d3ffbcfc425587eb37530916434ae88d86"} Jul 07 07:09:03.375359 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:03.375327 2565 scope.go:117] "RemoveContainer" containerID="f5e9278455d9644ac97545b02bf3f9d3ffbcfc425587eb37530916434ae88d86" Jul 07 07:09:03.376547 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:03.376506 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:09:03.376656 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:03.376627 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:09:03.376700 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:03.376665 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:09:04.382453 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:04.382415 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" event={"ID":"3d741e70-65e3-4375-92fb-51f48cb6e371","Type":"ContainerStarted","Data":"aabb018af980553c35f43d0dd112d55a1abf0d3212eba47c50e823b95cb184cb"} Jul 07 07:09:04.940976 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:04.940938 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:09:04.941188 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:04.940993 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-h26rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 07:09:04.941188 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:04.941071 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" podUID="3d741e70-65e3-4375-92fb-51f48cb6e371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 07:09:05.940632 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:05.940562 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-h26rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 07:09:05.941144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:05.940722 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" podUID="3d741e70-65e3-4375-92fb-51f48cb6e371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 07:09:06.940238 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:06.940188 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-h26rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 07:09:06.940442 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:06.940331 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" podUID="3d741e70-65e3-4375-92fb-51f48cb6e371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 07:09:07.940261 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:07.940222 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-h26rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 07 07:09:07.940868 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:07.940836 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" podUID="3d741e70-65e3-4375-92fb-51f48cb6e371" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 07 07:09:08.943486 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:08.943458 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:09:08.943943 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:08.943876 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:09:08.944616 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:08.944597 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h26rd" Jul 07 07:09:10.684187 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:10.684150 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:09:19.081479 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:19.081429 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:09:23.980959 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:23.979346 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:09:45.494984 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:45.494938 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:09:59.308224 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:09:59.308182 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:10:10.398769 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:10:10.398737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:11:31.383780 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:11:31.383740 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:11:42.192730 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:11:42.192697 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:11:52.183760 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:11:52.183722 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:12:01.889519 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:12:01.889484 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:12:12.188415 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:12:12.188327 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:12:40.676718 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:12:40.676685 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:12:52.798556 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:12:52.798517 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:13:28.119276 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:13:28.119238 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:13:37.489871 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:13:37.489832 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:13:45.693513 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:13:45.693426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:13:45.800015 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:13:45.799976 2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/systemd-tmpfiles-clean.service\": RecentStats: unable to find data in memory cache]" Jul 07 07:13:55.085941 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:13:55.085900 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:14:05.883104 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:14:05.883064 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:14:14.981613 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:14:14.980394 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:14:26.887266 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:14:26.887226 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:14:35.987264 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:14:35.987222 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:14:58.684598 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:14:58.684549 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:15:00.160144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.160114 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723475-sr874"] Jul 07 07:15:00.160555 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.160507 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe0c864-6c5e-4d80-893b-f89f9592cfd0" containerName="console" Jul 07 07:15:00.160555 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.160517 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe0c864-6c5e-4d80-893b-f89f9592cfd0" containerName="console" Jul 07 07:15:00.160654 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.160610 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe0c864-6c5e-4d80-893b-f89f9592cfd0" containerName="console" Jul 07 07:15:00.163898 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.163876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723475-sr874" Jul 07 07:15:00.166520 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.166501 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-z6nck\"" Jul 07 07:15:00.181064 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.181037 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723475-sr874"] Jul 07 07:15:00.317257 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.317222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ddd6\" (UniqueName: \"kubernetes.io/projected/47c41d51-5f23-436c-bdc4-fae1a9057093-kube-api-access-6ddd6\") pod \"maas-api-key-cleanup-29723475-sr874\" (UID: \"47c41d51-5f23-436c-bdc4-fae1a9057093\") " pod="opendatahub/maas-api-key-cleanup-29723475-sr874" Jul 07 07:15:00.418704 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.418612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ddd6\" (UniqueName: \"kubernetes.io/projected/47c41d51-5f23-436c-bdc4-fae1a9057093-kube-api-access-6ddd6\") pod \"maas-api-key-cleanup-29723475-sr874\" (UID: \"47c41d51-5f23-436c-bdc4-fae1a9057093\") " pod="opendatahub/maas-api-key-cleanup-29723475-sr874" Jul 07 07:15:00.428240 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.428206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ddd6\" (UniqueName: \"kubernetes.io/projected/47c41d51-5f23-436c-bdc4-fae1a9057093-kube-api-access-6ddd6\") pod \"maas-api-key-cleanup-29723475-sr874\" (UID: \"47c41d51-5f23-436c-bdc4-fae1a9057093\") " pod="opendatahub/maas-api-key-cleanup-29723475-sr874" Jul 07 07:15:00.474762 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.474729 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723475-sr874" Jul 07 07:15:00.612222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.612190 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723475-sr874"] Jul 07 07:15:00.614528 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:15:00.614501 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c41d51_5f23_436c_bdc4_fae1a9057093.slice/crio-51313f46e1aecba9d8a91567fe73621403c679c07c6bde4cc3c01e5372bf3fbd WatchSource:0}: Error finding container 51313f46e1aecba9d8a91567fe73621403c679c07c6bde4cc3c01e5372bf3fbd: Status 404 returned error can't find the container with id 51313f46e1aecba9d8a91567fe73621403c679c07c6bde4cc3c01e5372bf3fbd Jul 07 07:15:00.616422 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:00.616406 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 07:15:01.367744 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:01.367709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723475-sr874" event={"ID":"47c41d51-5f23-436c-bdc4-fae1a9057093","Type":"ContainerStarted","Data":"51313f46e1aecba9d8a91567fe73621403c679c07c6bde4cc3c01e5372bf3fbd"} Jul 07 07:15:10.682350 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:10.682315 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:15:15.454302 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:15.454271 2565 generic.go:356] "Generic (PLEG): container finished" podID="47c41d51-5f23-436c-bdc4-fae1a9057093" containerID="a44a0c55b1c16e17d617ebc4e70b10d7671827976d8be531a0f48e9d5709adaf" exitCode=0 Jul 07 07:15:15.454678 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:15.454358 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723475-sr874" event={"ID":"47c41d51-5f23-436c-bdc4-fae1a9057093","Type":"ContainerDied","Data":"a44a0c55b1c16e17d617ebc4e70b10d7671827976d8be531a0f48e9d5709adaf"} Jul 07 07:15:16.595278 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:16.595255 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723475-sr874" Jul 07 07:15:16.681174 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:16.681145 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ddd6\" (UniqueName: \"kubernetes.io/projected/47c41d51-5f23-436c-bdc4-fae1a9057093-kube-api-access-6ddd6\") pod \"47c41d51-5f23-436c-bdc4-fae1a9057093\" (UID: \"47c41d51-5f23-436c-bdc4-fae1a9057093\") " Jul 07 07:15:16.683244 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:16.683222 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47c41d51-5f23-436c-bdc4-fae1a9057093-kube-api-access-6ddd6" (OuterVolumeSpecName: "kube-api-access-6ddd6") pod "47c41d51-5f23-436c-bdc4-fae1a9057093" (UID: "47c41d51-5f23-436c-bdc4-fae1a9057093"). InnerVolumeSpecName "kube-api-access-6ddd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:15:16.781917 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:16.781829 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ddd6\" (UniqueName: \"kubernetes.io/projected/47c41d51-5f23-436c-bdc4-fae1a9057093-kube-api-access-6ddd6\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:15:17.467981 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:17.467898 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723475-sr874" Jul 07 07:15:17.467981 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:17.467914 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723475-sr874" event={"ID":"47c41d51-5f23-436c-bdc4-fae1a9057093","Type":"ContainerDied","Data":"51313f46e1aecba9d8a91567fe73621403c679c07c6bde4cc3c01e5372bf3fbd"} Jul 07 07:15:17.467981 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:17.467979 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51313f46e1aecba9d8a91567fe73621403c679c07c6bde4cc3c01e5372bf3fbd" Jul 07 07:15:33.179226 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:33.179186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:15:44.985807 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:44.985765 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:15:59.789950 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:15:59.789913 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:16:09.187203 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:16:09.187166 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:16:20.591165 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:16:20.591129 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:16:30.087107 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:16:30.087074 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:16:38.987992 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:16:38.987956 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:17:04.410724 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:04.410687 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc"] Jul 07 07:17:04.411302 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:04.410881 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" podUID="eca66373-bfaa-42ee-91b1-02c1b9b1eb04" containerName="manager" containerID="cri-o://43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11" gracePeriod=10 Jul 07 07:17:07.668338 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:07.668313 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:17:07.820523 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:07.820440 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msjmg\" (UniqueName: \"kubernetes.io/projected/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-kube-api-access-msjmg\") pod \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\" (UID: \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\") " Jul 07 07:17:07.820718 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:07.820559 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-extensions-socket-volume\") pod \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\" (UID: \"eca66373-bfaa-42ee-91b1-02c1b9b1eb04\") " Jul 07 07:17:07.820969 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:07.820947 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eca66373-bfaa-42ee-91b1-02c1b9b1eb04" (UID: "eca66373-bfaa-42ee-91b1-02c1b9b1eb04"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:17:07.822619 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:07.822596 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-kube-api-access-msjmg" (OuterVolumeSpecName: "kube-api-access-msjmg") pod "eca66373-bfaa-42ee-91b1-02c1b9b1eb04" (UID: "eca66373-bfaa-42ee-91b1-02c1b9b1eb04"). InnerVolumeSpecName "kube-api-access-msjmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:17:07.921943 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:07.921886 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-extensions-socket-volume\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:17:07.921943 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:07.921936 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msjmg\" (UniqueName: \"kubernetes.io/projected/eca66373-bfaa-42ee-91b1-02c1b9b1eb04-kube-api-access-msjmg\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:17:08.084960 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.084918 2565 generic.go:356] "Generic (PLEG): container finished" podID="eca66373-bfaa-42ee-91b1-02c1b9b1eb04" containerID="43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11" exitCode=0 Jul 07 07:17:08.085126 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.084970 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" Jul 07 07:17:08.085126 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.084971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" event={"ID":"eca66373-bfaa-42ee-91b1-02c1b9b1eb04","Type":"ContainerDied","Data":"43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11"} Jul 07 07:17:08.085126 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.085077 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc" event={"ID":"eca66373-bfaa-42ee-91b1-02c1b9b1eb04","Type":"ContainerDied","Data":"5214f6d4d6a1070895e23258c772e469b1c85ed80dfc1f4dd171a3375a36ed50"} Jul 07 07:17:08.085126 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.085108 2565 scope.go:117] "RemoveContainer" containerID="43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11" Jul 07 07:17:08.095134 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.095116 2565 scope.go:117] "RemoveContainer" containerID="43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11" Jul 07 07:17:08.095387 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:17:08.095367 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11\": container with ID starting with 43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11 not found: ID does not exist" containerID="43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11" Jul 07 07:17:08.095437 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.095396 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11"} err="failed to get container status \"43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11\": rpc error: code = NotFound desc = could not find container \"43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11\": container with ID starting with 43d7e605e5340e1144ae576bfd0d97c8f9211ed62de34b0c84b077cb2e47bd11 not found: ID does not exist" Jul 07 07:17:08.110869 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.110834 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc"] Jul 07 07:17:08.119609 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:08.118233 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2gdxc"] Jul 07 07:17:09.134774 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:17:09.134739 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eca66373-bfaa-42ee-91b1-02c1b9b1eb04" path="/var/lib/kubelet/pods/eca66373-bfaa-42ee-91b1-02c1b9b1eb04/volumes" Jul 07 07:18:05.631153 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.631116 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q"] Jul 07 07:18:05.632692 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.632665 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca66373-bfaa-42ee-91b1-02c1b9b1eb04" containerName="manager" Jul 07 07:18:05.632853 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.632842 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca66373-bfaa-42ee-91b1-02c1b9b1eb04" containerName="manager" Jul 07 07:18:05.632969 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.632959 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47c41d51-5f23-436c-bdc4-fae1a9057093" containerName="cleanup" Jul 07 07:18:05.633039 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.633031 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="47c41d51-5f23-436c-bdc4-fae1a9057093" containerName="cleanup" Jul 07 07:18:05.633351 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.633335 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca66373-bfaa-42ee-91b1-02c1b9b1eb04" containerName="manager" Jul 07 07:18:05.633513 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.633453 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="47c41d51-5f23-436c-bdc4-fae1a9057093" containerName="cleanup" Jul 07 07:18:05.638099 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.638081 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:05.641907 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.641877 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4thjq\"" Jul 07 07:18:05.647054 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.647034 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q"] Jul 07 07:18:05.735367 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.735325 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh22v\" (UniqueName: \"kubernetes.io/projected/1e3cd4b1-3c77-4da9-9155-aa39a811a781-kube-api-access-qh22v\") pod \"kuadrant-operator-controller-manager-86878c769f-2268q\" (UID: \"1e3cd4b1-3c77-4da9-9155-aa39a811a781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:05.735544 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.735501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3cd4b1-3c77-4da9-9155-aa39a811a781-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2268q\" (UID: \"1e3cd4b1-3c77-4da9-9155-aa39a811a781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:05.836307 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.836273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3cd4b1-3c77-4da9-9155-aa39a811a781-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2268q\" (UID: \"1e3cd4b1-3c77-4da9-9155-aa39a811a781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:05.836472 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.836314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh22v\" (UniqueName: \"kubernetes.io/projected/1e3cd4b1-3c77-4da9-9155-aa39a811a781-kube-api-access-qh22v\") pod \"kuadrant-operator-controller-manager-86878c769f-2268q\" (UID: \"1e3cd4b1-3c77-4da9-9155-aa39a811a781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:05.836719 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.836698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3cd4b1-3c77-4da9-9155-aa39a811a781-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2268q\" (UID: \"1e3cd4b1-3c77-4da9-9155-aa39a811a781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:05.847249 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.847228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh22v\" (UniqueName: \"kubernetes.io/projected/1e3cd4b1-3c77-4da9-9155-aa39a811a781-kube-api-access-qh22v\") pod \"kuadrant-operator-controller-manager-86878c769f-2268q\" (UID: \"1e3cd4b1-3c77-4da9-9155-aa39a811a781\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:05.949402 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:05.949273 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:06.096608 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:06.096546 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q"] Jul 07 07:18:06.098256 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:18:06.098221 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3cd4b1_3c77_4da9_9155_aa39a811a781.slice/crio-f1023b499298253376a9e28590371262af6b693cf5a881c438b64e3b8a4a83e1 WatchSource:0}: Error finding container f1023b499298253376a9e28590371262af6b693cf5a881c438b64e3b8a4a83e1: Status 404 returned error can't find the container with id f1023b499298253376a9e28590371262af6b693cf5a881c438b64e3b8a4a83e1 Jul 07 07:18:06.411064 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:06.411031 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" event={"ID":"1e3cd4b1-3c77-4da9-9155-aa39a811a781","Type":"ContainerStarted","Data":"bd3dd1c760ac1c54579c61490a9894024e3bfd82a02a05319b820415d8441981"} Jul 07 07:18:06.411235 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:06.411079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" event={"ID":"1e3cd4b1-3c77-4da9-9155-aa39a811a781","Type":"ContainerStarted","Data":"f1023b499298253376a9e28590371262af6b693cf5a881c438b64e3b8a4a83e1"} Jul 07 07:18:06.411235 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:06.411115 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:06.439949 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:06.439894 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" podStartSLOduration=1.439876484 podStartE2EDuration="1.439876484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:18:06.437520013 +0000 UTC m=+1159.862733283" watchObservedRunningTime="2026-07-07 07:18:06.439876484 +0000 UTC m=+1159.865089730" Jul 07 07:18:17.420765 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:17.420686 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2268q" Jul 07 07:18:27.192473 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:27.192436 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:18:38.441220 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:38.441188 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:18:49.715599 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:49.715558 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:18:58.496687 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:18:58.493408 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:19:08.718998 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:19:08.718960 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:19:16.416515 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:19:16.416478 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:19:25.911149 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:19:25.911113 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:19:37.799573 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:19:37.799536 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:19:45.892627 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:19:45.892530 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:19:56.404244 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:19:56.404213 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:20:03.695988 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:20:03.695950 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:20:15.084467 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:20:15.084427 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:20:36.687363 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:20:36.687321 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:20:45.399101 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:20:45.399066 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:20:54.484752 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:20:54.484718 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:21:04.487443 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:21:04.487407 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:21:29.694026 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:21:29.693988 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:21:38.478549 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:21:38.478506 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:21:46.585022 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:21:46.584989 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:21:57.188180 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:21:57.188140 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:22:06.092610 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:22:06.088902 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:22:19.584373 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:22:19.584335 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:22:27.991935 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:22:27.991892 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:22:37.302874 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:22:37.302839 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:22:49.090305 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:22:49.090212 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:23:08.279403 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:08.279361 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:23:20.683272 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:20.683234 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:23:33.194909 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:33.194871 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:23:45.724336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:45.724297 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:23:57.946261 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.946227 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz"] Jul 07 07:23:57.950098 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.950078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.952437 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.952412 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-646cbfff-openshift-default-dockercfg-qrknf\"" Jul 07 07:23:57.971701 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.971665 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz"] Jul 07 07:23:57.988529 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988499 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istiod-ca-cert\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.988696 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-socket\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.988696 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-certs\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.988696 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-envoy\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.988808 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-credential-socket\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.988808 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-podinfo\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.988808 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-data\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.988808 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-token\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:57.988935 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:57.988820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j842\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-kube-api-access-7j842\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089294 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istiod-ca-cert\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-socket\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089341 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-certs\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-envoy\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-credential-socket\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-podinfo\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089453 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-data\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089852 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-token\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089852 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j842\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-kube-api-access-7j842\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089965 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-credential-socket\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089965 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-data\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.089965 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.089939 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-socket\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.090121 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.090035 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istiod-ca-cert\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.090302 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.090279 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-certs\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.091932 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.091909 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-envoy\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.092113 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.092091 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-podinfo\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.099814 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.099789 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-token\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.100022 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.099999 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j842\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-kube-api-access-7j842\") pod \"e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.261701 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.261604 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:23:58.410484 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.407775 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz"] Jul 07 07:23:58.413227 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.413195 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:23:58.413370 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.413281 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:23:58.413370 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:58.413328 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:23:59.404904 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:59.404874 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" event={"ID":"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b","Type":"ContainerStarted","Data":"83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc"} Jul 07 07:23:59.405399 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:59.404921 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" event={"ID":"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b","Type":"ContainerStarted","Data":"9b3d1021c1828e19a0917221e6c7806c8e271f29987f5c30ed132e545afb3a72"} Jul 07 07:23:59.434453 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:23:59.434399 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" podStartSLOduration=2.434352654 podStartE2EDuration="2.434352654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:23:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:23:59.433975998 +0000 UTC m=+1512.859189287" watchObservedRunningTime="2026-07-07 07:23:59.434352654 +0000 UTC m=+1512.859565938" Jul 07 07:24:00.262820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:00.262776 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:24:00.267761 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:00.267733 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:24:00.410861 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:00.410829 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:24:00.411693 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:00.411674 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:24:04.476372 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:04.476339 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz"] Jul 07 07:24:04.476873 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:04.476572 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" podUID="4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" containerName="istio-proxy" containerID="cri-o://83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc" gracePeriod=30 Jul 07 07:24:09.732210 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.732184 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:24:09.802672 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802571 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-credential-socket\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.802672 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802641 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-envoy\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.802905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802692 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j842\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-kube-api-access-7j842\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.802905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802740 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-certs\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.802905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802771 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-podinfo\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.802905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802805 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:09.802905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802821 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-socket\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.802905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802879 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-data\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.803225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802967 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istiod-ca-cert\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.803225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803003 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-token\") pod \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\" (UID: \"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b\") " Jul 07 07:24:09.803225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.802997 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:09.803225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803096 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:09.803433 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803239 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:09.803433 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803325 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:24:09.803545 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803435 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:09.803545 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803453 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:09.803545 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803467 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:09.803545 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803481 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:09.803545 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.803495 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:09.805161 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.805129 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:24:09.805290 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.805163 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:24:09.805290 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.805259 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:09.805375 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.805283 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-kube-api-access-7j842" (OuterVolumeSpecName: "kube-api-access-7j842") pod "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" (UID: "4933589a-3218-4d52-a1bd-8a4dc7c4bd3b"). InnerVolumeSpecName "kube-api-access-7j842". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:24:09.904840 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.904805 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j842\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-kube-api-access-7j842\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:09.904840 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.904835 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:09.904840 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.904844 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:09.905077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:09.904854 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:10.470383 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.470343 2565 generic.go:356] "Generic (PLEG): container finished" podID="4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" containerID="83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc" exitCode=0 Jul 07 07:24:10.470556 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.470403 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" Jul 07 07:24:10.470556 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.470422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" event={"ID":"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b","Type":"ContainerDied","Data":"83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc"} Jul 07 07:24:10.470556 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.470494 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz" event={"ID":"4933589a-3218-4d52-a1bd-8a4dc7c4bd3b","Type":"ContainerDied","Data":"9b3d1021c1828e19a0917221e6c7806c8e271f29987f5c30ed132e545afb3a72"} Jul 07 07:24:10.470556 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.470517 2565 scope.go:117] "RemoveContainer" containerID="83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc" Jul 07 07:24:10.480313 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.480296 2565 scope.go:117] "RemoveContainer" containerID="83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc" Jul 07 07:24:10.480561 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:24:10.480541 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc\": container with ID starting with 83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc not found: ID does not exist" containerID="83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc" Jul 07 07:24:10.480691 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.480569 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc"} err="failed to get container status \"83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc\": rpc error: code = NotFound desc = could not find container \"83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc\": container with ID starting with 83b58e8a531a27c160f8c7cab6dcabca3f780ced6b5b7cf5444578d7e36aeedc not found: ID does not exist" Jul 07 07:24:10.496195 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.496166 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz"] Jul 07 07:24:10.500988 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.500963 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-646cbfff-openshift-default-5bfc74df57-hk5vz"] Jul 07 07:24:10.946158 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.946125 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9"] Jul 07 07:24:10.946790 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.946765 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" containerName="istio-proxy" Jul 07 07:24:10.946790 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.946792 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" containerName="istio-proxy" Jul 07 07:24:10.946939 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.946908 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" containerName="istio-proxy" Jul 07 07:24:10.951807 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.951786 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:10.954237 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.954217 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2cb4b8b0-openshift-default-dockercfg-89fzn\"" Jul 07 07:24:10.964402 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:10.964376 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9"] Jul 07 07:24:11.013289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwf7b\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-kube-api-access-kwf7b\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.013289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-podinfo\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.013496 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013325 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51befbdc-a171-4754-ae8d-8384fe4c6620-istiod-ca-cert\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.013496 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-credential-socket\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.013496 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-socket\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.013496 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-certs\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.013662 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-envoy\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.013662 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-data\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.013662 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.013541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-token\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.114836 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.114803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51befbdc-a171-4754-ae8d-8384fe4c6620-istiod-ca-cert\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.114836 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.114839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-credential-socket\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115074 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.114857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-socket\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115074 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.114886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-certs\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115074 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.114959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-envoy\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115074 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.114981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-data\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115074 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.115008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-token\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.115086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwf7b\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-kube-api-access-kwf7b\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.115118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-podinfo\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.115290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-credential-socket\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115531 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.115339 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-socket\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115531 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.115422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-certs\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115722 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.115570 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51befbdc-a171-4754-ae8d-8384fe4c6620-istiod-ca-cert\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.115722 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.115633 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-data\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.117409 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.117391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-envoy\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.117574 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.117554 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-podinfo\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.125271 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.125236 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-token\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.125471 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.125450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwf7b\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-kube-api-access-kwf7b\") pod \"e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.135417 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.135391 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4933589a-3218-4d52-a1bd-8a4dc7c4bd3b" path="/var/lib/kubelet/pods/4933589a-3218-4d52-a1bd-8a4dc7c4bd3b/volumes" Jul 07 07:24:11.262926 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.262827 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:11.403920 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.403898 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9"] Jul 07 07:24:11.405946 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:24:11.405920 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51befbdc_a171_4754_ae8d_8384fe4c6620.slice/crio-2e6853e7429579fc895b3ff96232308c0b6b14fb95828b56c35cf228520b5439 WatchSource:0}: Error finding container 2e6853e7429579fc895b3ff96232308c0b6b14fb95828b56c35cf228520b5439: Status 404 returned error can't find the container with id 2e6853e7429579fc895b3ff96232308c0b6b14fb95828b56c35cf228520b5439 Jul 07 07:24:11.408257 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.408229 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:24:11.408335 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.408325 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:24:11.408376 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.408359 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:24:11.481344 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:11.481317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" event={"ID":"51befbdc-a171-4754-ae8d-8384fe4c6620","Type":"ContainerStarted","Data":"2e6853e7429579fc895b3ff96232308c0b6b14fb95828b56c35cf228520b5439"} Jul 07 07:24:12.490076 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:12.490039 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" event={"ID":"51befbdc-a171-4754-ae8d-8384fe4c6620","Type":"ContainerStarted","Data":"10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8"} Jul 07 07:24:12.512847 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:12.512804 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" podStartSLOduration=2.512789733 podStartE2EDuration="2.512789733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:24:12.509992091 +0000 UTC m=+1525.935205382" watchObservedRunningTime="2026-07-07 07:24:12.512789733 +0000 UTC m=+1525.938003002" Jul 07 07:24:13.263327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:13.263291 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:13.268004 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:13.267982 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:13.496201 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:13.496170 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:13.502921 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:13.502888 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:23.269849 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:23.269811 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9"] Jul 07 07:24:23.270404 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:23.269999 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" podUID="51befbdc-a171-4754-ae8d-8384fe4c6620" containerName="istio-proxy" containerID="cri-o://10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8" gracePeriod=30 Jul 07 07:24:28.530374 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.530344 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:28.588887 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.588856 2565 generic.go:356] "Generic (PLEG): container finished" podID="51befbdc-a171-4754-ae8d-8384fe4c6620" containerID="10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8" exitCode=0 Jul 07 07:24:28.589072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.588912 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" Jul 07 07:24:28.589072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.588918 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" event={"ID":"51befbdc-a171-4754-ae8d-8384fe4c6620","Type":"ContainerDied","Data":"10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8"} Jul 07 07:24:28.589072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.589051 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" event={"ID":"51befbdc-a171-4754-ae8d-8384fe4c6620","Type":"ContainerDied","Data":"2e6853e7429579fc895b3ff96232308c0b6b14fb95828b56c35cf228520b5439"} Jul 07 07:24:28.589270 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.589079 2565 scope.go:117] "RemoveContainer" containerID="10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8" Jul 07 07:24:28.598192 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.598169 2565 scope.go:117] "RemoveContainer" containerID="10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8" Jul 07 07:24:28.598461 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:24:28.598444 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8\": container with ID starting with 10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8 not found: ID does not exist" containerID="10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8" Jul 07 07:24:28.598523 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.598467 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8"} err="failed to get container status \"10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8\": rpc error: code = NotFound desc = could not find container \"10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8\": container with ID starting with 10714375e5ff715cc64a991dad9c041e3cee430f98e4d94bc1cd860ec945d2b8 not found: ID does not exist" Jul 07 07:24:28.694639 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694551 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-certs\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.694639 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694658 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-data\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.694878 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694730 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-token\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.694878 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694753 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-envoy\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.694878 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694777 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-credential-socket\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.694878 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694811 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwf7b\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-kube-api-access-kwf7b\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.694878 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694832 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-podinfo\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.694878 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694877 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-socket\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.695198 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694927 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51befbdc-a171-4754-ae8d-8384fe4c6620-istiod-ca-cert\") pod \"51befbdc-a171-4754-ae8d-8384fe4c6620\" (UID: \"51befbdc-a171-4754-ae8d-8384fe4c6620\") " Jul 07 07:24:28.695198 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.694945 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-data" (OuterVolumeSpecName: "istio-data") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:28.695198 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.695146 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:28.695364 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.695208 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:28.695364 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.695220 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:28.695364 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.695248 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.695364 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.695268 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.695575 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.695442 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51befbdc-a171-4754-ae8d-8384fe4c6620-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:24:28.697013 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.696984 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:28.697135 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.697092 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-kube-api-access-kwf7b" (OuterVolumeSpecName: "kube-api-access-kwf7b") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "kube-api-access-kwf7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:24:28.697371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.697345 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:24:28.697371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.697351 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-token" (OuterVolumeSpecName: "istio-token") pod "51befbdc-a171-4754-ae8d-8384fe4c6620" (UID: "51befbdc-a171-4754-ae8d-8384fe4c6620"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:24:28.796251 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.796205 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.796251 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.796241 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.796251 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.796254 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwf7b\" (UniqueName: \"kubernetes.io/projected/51befbdc-a171-4754-ae8d-8384fe4c6620-kube-api-access-kwf7b\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.796502 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.796267 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51befbdc-a171-4754-ae8d-8384fe4c6620-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.796502 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.796279 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.796502 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.796290 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51befbdc-a171-4754-ae8d-8384fe4c6620-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.796502 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.796301 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51befbdc-a171-4754-ae8d-8384fe4c6620-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:28.918628 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.918594 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9"] Jul 07 07:24:28.924879 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:28.924849 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9"] Jul 07 07:24:29.134868 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:29.134830 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51befbdc-a171-4754-ae8d-8384fe4c6620" path="/var/lib/kubelet/pods/51befbdc-a171-4754-ae8d-8384fe4c6620/volumes" Jul 07 07:24:29.497191 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:29.497130 2565 patch_prober.go:28] interesting pod/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 07:24:29.497392 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:29.497228 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2cb4b8b0-openshift-default-67b9f546c7-hdqb9" podUID="51befbdc-a171-4754-ae8d-8384fe4c6620" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 07:24:30.108847 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.108802 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs"] Jul 07 07:24:30.109502 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.109482 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51befbdc-a171-4754-ae8d-8384fe4c6620" containerName="istio-proxy" Jul 07 07:24:30.109598 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.109507 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="51befbdc-a171-4754-ae8d-8384fe4c6620" containerName="istio-proxy" Jul 07 07:24:30.109687 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.109625 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="51befbdc-a171-4754-ae8d-8384fe4c6620" containerName="istio-proxy" Jul 07 07:24:30.114555 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.114538 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.117235 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.117214 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3b8063ff-openshift-default-dockercfg-nkxnz\"" Jul 07 07:24:30.126932 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.126895 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs"] Jul 07 07:24:30.211991 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.211953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-certs\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.211991 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.211992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-data\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.212270 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.212015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-credential-socket\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.212270 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.212033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdnd\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-kube-api-access-nkdnd\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.212270 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.212152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-token\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.212270 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.212199 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-socket\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.212640 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.212290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-podinfo\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.212640 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.212319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istiod-ca-cert\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.212640 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.212339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-envoy\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313121 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istiod-ca-cert\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-envoy\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-certs\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-data\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-credential-socket\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313261 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdnd\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-kube-api-access-nkdnd\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-token\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-socket\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-podinfo\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313797 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313688 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-data\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313797 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313736 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-credential-socket\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313888 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-socket\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.313942 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.313901 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-certs\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.314021 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.314004 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istiod-ca-cert\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.315845 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.315824 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-envoy\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.315974 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.315958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-podinfo\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.323813 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.323778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-token\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.323962 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.323900 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdnd\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-kube-api-access-nkdnd\") pod \"e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.427024 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.426922 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:30.588445 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.588401 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs"] Jul 07 07:24:30.590885 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:24:30.590852 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd8adba_276b_4f83_bd4f_9a79e01a90d5.slice/crio-8786b1213959c0a7ad718a2faca8d037dfe0f28e70f89c48cb1b972777e9eab8 WatchSource:0}: Error finding container 8786b1213959c0a7ad718a2faca8d037dfe0f28e70f89c48cb1b972777e9eab8: Status 404 returned error can't find the container with id 8786b1213959c0a7ad718a2faca8d037dfe0f28e70f89c48cb1b972777e9eab8 Jul 07 07:24:30.593431 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.593386 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:24:30.593528 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.593495 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:24:30.593619 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.593545 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:24:30.603008 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:30.602975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" event={"ID":"7fd8adba-276b-4f83-bd4f-9a79e01a90d5","Type":"ContainerStarted","Data":"8786b1213959c0a7ad718a2faca8d037dfe0f28e70f89c48cb1b972777e9eab8"} Jul 07 07:24:31.610212 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:31.610169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" event={"ID":"7fd8adba-276b-4f83-bd4f-9a79e01a90d5","Type":"ContainerStarted","Data":"d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971"} Jul 07 07:24:31.641694 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:31.641643 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" podStartSLOduration=1.641628487 podStartE2EDuration="1.641628487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:24:31.640083462 +0000 UTC m=+1545.065296732" watchObservedRunningTime="2026-07-07 07:24:31.641628487 +0000 UTC m=+1545.066841766" Jul 07 07:24:32.428127 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:32.428088 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:32.433035 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:32.433007 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:32.616507 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:32.616475 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:32.617673 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:32.617645 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:33.793390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:33.793356 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:24:35.877635 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:35.877596 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs"] Jul 07 07:24:35.878065 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:35.877782 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" podUID="7fd8adba-276b-4f83-bd4f-9a79e01a90d5" containerName="istio-proxy" containerID="cri-o://d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971" gracePeriod=30 Jul 07 07:24:41.633918 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.633892 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:41.679432 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.679338 2565 generic.go:356] "Generic (PLEG): container finished" podID="7fd8adba-276b-4f83-bd4f-9a79e01a90d5" containerID="d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971" exitCode=0 Jul 07 07:24:41.679432 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.679397 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" Jul 07 07:24:41.679713 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.679425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" event={"ID":"7fd8adba-276b-4f83-bd4f-9a79e01a90d5","Type":"ContainerDied","Data":"d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971"} Jul 07 07:24:41.679713 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.679490 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs" event={"ID":"7fd8adba-276b-4f83-bd4f-9a79e01a90d5","Type":"ContainerDied","Data":"8786b1213959c0a7ad718a2faca8d037dfe0f28e70f89c48cb1b972777e9eab8"} Jul 07 07:24:41.679713 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.679522 2565 scope.go:117] "RemoveContainer" containerID="d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971" Jul 07 07:24:41.688927 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.688903 2565 scope.go:117] "RemoveContainer" containerID="d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971" Jul 07 07:24:41.689272 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:24:41.689251 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971\": container with ID starting with d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971 not found: ID does not exist" containerID="d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971" Jul 07 07:24:41.689342 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.689280 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971"} err="failed to get container status \"d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971\": rpc error: code = NotFound desc = could not find container \"d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971\": container with ID starting with d35982ca77fe8472da66ebe38810551e4662637df7cd25597165b08934485971 not found: ID does not exist" Jul 07 07:24:41.723781 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.723743 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkdnd\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-kube-api-access-nkdnd\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.723982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.723805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-credential-socket\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.723982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.723839 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istiod-ca-cert\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.723982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.723902 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-certs\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.723982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.723919 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-data\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.723982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.723942 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-envoy\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.723982 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.723980 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-token\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.724285 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.724003 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-podinfo\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.724285 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.724174 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:41.724285 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.724188 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:41.724686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.724664 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:24:41.724920 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.724885 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:41.725074 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.725058 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-socket\") pod \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\" (UID: \"7fd8adba-276b-4f83-bd4f-9a79e01a90d5\") " Jul 07 07:24:41.725323 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.725294 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:41.725731 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.725701 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:41.725731 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.725729 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:41.725904 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.725744 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:41.725904 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.725758 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:41.725904 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.725773 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:41.726571 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.726549 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-kube-api-access-nkdnd" (OuterVolumeSpecName: "kube-api-access-nkdnd") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "kube-api-access-nkdnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:24:41.726675 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.726555 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:24:41.726675 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.726600 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:24:41.726879 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.726858 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7fd8adba-276b-4f83-bd4f-9a79e01a90d5" (UID: "7fd8adba-276b-4f83-bd4f-9a79e01a90d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:24:41.826280 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.826216 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkdnd\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-kube-api-access-nkdnd\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:41.826280 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.826278 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:41.826280 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.826288 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:41.826528 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:41.826296 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd8adba-276b-4f83-bd4f-9a79e01a90d5-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:24:42.003533 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:42.003501 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs"] Jul 07 07:24:42.008224 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:42.008200 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3b8063ff-openshift-default-5d4d658f5-rvkrs"] Jul 07 07:24:43.133866 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:43.133836 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd8adba-276b-4f83-bd4f-9a79e01a90d5" path="/var/lib/kubelet/pods/7fd8adba-276b-4f83-bd4f-9a79e01a90d5/volumes" Jul 07 07:24:46.190480 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:24:46.190446 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:26:05.894852 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:05.894754 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:26:13.186188 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:13.186152 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:26:20.354694 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.354665 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc"] Jul 07 07:26:20.355213 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.355195 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd8adba-276b-4f83-bd4f-9a79e01a90d5" containerName="istio-proxy" Jul 07 07:26:20.355263 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.355215 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd8adba-276b-4f83-bd4f-9a79e01a90d5" containerName="istio-proxy" Jul 07 07:26:20.355299 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.355295 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd8adba-276b-4f83-bd4f-9a79e01a90d5" containerName="istio-proxy" Jul 07 07:26:20.358306 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.358291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.362629 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.362608 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8305e258-openshift-default-dockercfg-j94dv\"" Jul 07 07:26:20.380715 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.380692 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc"] Jul 07 07:26:20.467719 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.467669 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22mw7\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-kube-api-access-22mw7\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.467914 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.467781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-podinfo\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.467914 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.467816 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-token\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.467914 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.467838 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb6327b-2bff-4213-ade7-124b3739fe3e-istiod-ca-cert\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.467914 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.467858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-envoy\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.468072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.467943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-data\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.468072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.467964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-socket\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.468072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.467987 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-credential-socket\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.468072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.468008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-certs\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.568708 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.568673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-socket\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.568901 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.568715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-credential-socket\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.568901 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.568734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-certs\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.568901 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.568755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22mw7\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-kube-api-access-22mw7\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.568901 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.568812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-podinfo\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.568901 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.568831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-token\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.569172 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.568864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb6327b-2bff-4213-ade7-124b3739fe3e-istiod-ca-cert\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.569172 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.569139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-envoy\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.569294 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.569191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-socket\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.569294 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.569143 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-credential-socket\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.569294 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.569266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-data\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.569522 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.569499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-data\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.569627 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.569612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-certs\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.569682 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.569656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb6327b-2bff-4213-ade7-124b3739fe3e-istiod-ca-cert\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.571234 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.571216 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-envoy\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.571307 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.571289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-podinfo\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.578909 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.578880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-token\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.579059 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.578968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22mw7\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-kube-api-access-22mw7\") pod \"e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.668907 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.668825 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:20.795750 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.795718 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:26:20.813852 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.813831 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc"] Jul 07 07:26:20.815727 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:26:20.815702 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb6327b_2bff_4213_ade7_124b3739fe3e.slice/crio-2eda749bd57acaa4844697d9185e2345df0320034f01839ca8fa81bb1cfb2650 WatchSource:0}: Error finding container 2eda749bd57acaa4844697d9185e2345df0320034f01839ca8fa81bb1cfb2650: Status 404 returned error can't find the container with id 2eda749bd57acaa4844697d9185e2345df0320034f01839ca8fa81bb1cfb2650 Jul 07 07:26:20.817762 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.817732 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:26:20.817866 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.817801 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:26:20.817866 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:20.817853 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:26:21.226129 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:21.226093 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" event={"ID":"fbb6327b-2bff-4213-ade7-124b3739fe3e","Type":"ContainerStarted","Data":"6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890"} Jul 07 07:26:21.226340 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:21.226152 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" event={"ID":"fbb6327b-2bff-4213-ade7-124b3739fe3e","Type":"ContainerStarted","Data":"2eda749bd57acaa4844697d9185e2345df0320034f01839ca8fa81bb1cfb2650"} Jul 07 07:26:21.254010 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:21.253961 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" podStartSLOduration=1.253947269 podStartE2EDuration="1.253947269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:26:21.250971766 +0000 UTC m=+1654.676185037" watchObservedRunningTime="2026-07-07 07:26:21.253947269 +0000 UTC m=+1654.679160538" Jul 07 07:26:21.669325 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:21.669292 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:21.674418 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:21.674394 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:22.232526 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:22.232497 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:22.233606 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:22.233564 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:28.189037 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:28.189001 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:26:36.311892 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:36.311803 2565 generic.go:356] "Generic (PLEG): container finished" podID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerID="6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890" exitCode=0 Jul 07 07:26:36.311892 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:36.311875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" event={"ID":"fbb6327b-2bff-4213-ade7-124b3739fe3e","Type":"ContainerDied","Data":"6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890"} Jul 07 07:26:36.312344 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:36.312305 2565 scope.go:117] "RemoveContainer" containerID="6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890" Jul 07 07:26:36.313369 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:36.313345 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:26:36.313426 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:36.313406 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:26:36.313461 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:36.313437 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:26:37.233331 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:37.233258 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:37.321193 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:37.321157 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" event={"ID":"fbb6327b-2bff-4213-ade7-124b3739fe3e","Type":"ContainerStarted","Data":"75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15"} Jul 07 07:26:37.669274 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:37.669230 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:37.670544 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:37.670518 2565 patch_prober.go:28] interesting pod/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 07 07:26:37.670679 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:37.670604 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 07 07:26:38.669411 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:38.669377 2565 patch_prober.go:28] interesting pod/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 07 07:26:38.669832 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:38.669428 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 07 07:26:39.669488 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:39.669447 2565 patch_prober.go:28] interesting pod/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 07 07:26:39.669894 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:39.669514 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 07 07:26:40.669540 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:40.669505 2565 patch_prober.go:28] interesting pod/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 07 07:26:40.669941 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:40.669556 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 07 07:26:41.673802 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:41.673769 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:41.674240 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:41.674056 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:41.674670 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:41.674654 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:41.784666 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:41.784628 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:26:42.523174 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:42.523138 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc"] Jul 07 07:26:43.364391 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:43.364362 2565 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" secret="" err="secret \"e2e-mt-8305e258-openshift-default-dockercfg-j94dv\" not found" Jul 07 07:26:44.369297 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:44.369240 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" containerID="cri-o://75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15" gracePeriod=30 Jul 07 07:26:49.626565 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.626535 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:49.657570 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657496 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-credential-socket\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.657570 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657536 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-podinfo\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.657794 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657570 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb6327b-2bff-4213-ade7-124b3739fe3e-istiod-ca-cert\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.657794 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657608 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-certs\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.657794 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657643 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-socket\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.657794 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657695 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-token\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.657794 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657778 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-envoy\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.658045 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657823 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22mw7\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-kube-api-access-22mw7\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.658045 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657860 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-data\") pod \"fbb6327b-2bff-4213-ade7-124b3739fe3e\" (UID: \"fbb6327b-2bff-4213-ade7-124b3739fe3e\") " Jul 07 07:26:49.658045 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.657894 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:26:49.658045 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.658016 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:26:49.658260 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.658060 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbb6327b-2bff-4213-ade7-124b3739fe3e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:26:49.658260 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.658225 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:26:49.658368 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.658306 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:49.658368 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.658323 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbb6327b-2bff-4213-ade7-124b3739fe3e-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:49.658368 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.658338 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:49.658368 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.658351 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:49.658883 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.658860 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:26:49.659871 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.659850 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:26:49.660222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.660199 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:26:49.660352 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.660334 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-kube-api-access-22mw7" (OuterVolumeSpecName: "kube-api-access-22mw7") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "kube-api-access-22mw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:26:49.660398 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.660350 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbb6327b-2bff-4213-ade7-124b3739fe3e" (UID: "fbb6327b-2bff-4213-ade7-124b3739fe3e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:26:49.759530 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.759499 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:49.759530 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.759526 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22mw7\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-kube-api-access-22mw7\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:49.759530 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.759535 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:49.759775 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.759543 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:49.759775 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:49.759551 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbb6327b-2bff-4213-ade7-124b3739fe3e-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:26:50.401762 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.401731 2565 generic.go:356] "Generic (PLEG): container finished" podID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerID="75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15" exitCode=0 Jul 07 07:26:50.401945 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.401775 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" event={"ID":"fbb6327b-2bff-4213-ade7-124b3739fe3e","Type":"ContainerDied","Data":"75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15"} Jul 07 07:26:50.401945 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.401778 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" Jul 07 07:26:50.401945 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.401817 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc" event={"ID":"fbb6327b-2bff-4213-ade7-124b3739fe3e","Type":"ContainerDied","Data":"2eda749bd57acaa4844697d9185e2345df0320034f01839ca8fa81bb1cfb2650"} Jul 07 07:26:50.401945 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.401839 2565 scope.go:117] "RemoveContainer" containerID="75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15" Jul 07 07:26:50.411996 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.411980 2565 scope.go:117] "RemoveContainer" containerID="6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890" Jul 07 07:26:50.420373 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.420353 2565 scope.go:117] "RemoveContainer" containerID="75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15" Jul 07 07:26:50.420641 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:26:50.420623 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15\": container with ID starting with 75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15 not found: ID does not exist" containerID="75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15" Jul 07 07:26:50.420726 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.420655 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15"} err="failed to get container status \"75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15\": rpc error: code = NotFound desc = could not find container \"75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15\": container with ID starting with 75c75a02f8405b679d07c7994067bb4185489f8822af7b3ef685342630c11d15 not found: ID does not exist" Jul 07 07:26:50.420726 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.420678 2565 scope.go:117] "RemoveContainer" containerID="6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890" Jul 07 07:26:50.420923 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:26:50.420906 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890\": container with ID starting with 6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890 not found: ID does not exist" containerID="6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890" Jul 07 07:26:50.420964 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.420931 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890"} err="failed to get container status \"6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890\": rpc error: code = NotFound desc = could not find container \"6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890\": container with ID starting with 6a82d884540b9fbcd0b12d60395579706e54a0fd1cce1925cff9604879edb890 not found: ID does not exist" Jul 07 07:26:50.427869 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.427840 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc"] Jul 07 07:26:50.436400 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:50.436378 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8305e258-openshift-default-d4b6c66f9-r2ztc"] Jul 07 07:26:51.134238 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:26:51.134195 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" path="/var/lib/kubelet/pods/fbb6327b-2bff-4213-ade7-124b3739fe3e/volumes" Jul 07 07:27:03.075572 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.075533 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278"] Jul 07 07:27:03.076150 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.076131 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" Jul 07 07:27:03.076215 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.076153 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" Jul 07 07:27:03.076285 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.076274 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" Jul 07 07:27:03.076320 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.076287 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" Jul 07 07:27:03.081061 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.081039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.083539 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.083517 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-18ebf0cb-openshift-default-dockercfg-jddxf\"" Jul 07 07:27:03.091829 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.091801 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278"] Jul 07 07:27:03.189465 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-credential-socket\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.189693 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-data\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.189693 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-certs\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.189693 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tsm\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-kube-api-access-p5tsm\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.189693 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5112431-3560-4483-8d61-9e760f46323c-istio-podinfo\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.189693 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-envoy\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.189693 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-socket\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.190072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-istio-token\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.190072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.189784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5112431-3560-4483-8d61-9e760f46323c-istiod-ca-cert\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.290790 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.290755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5112431-3560-4483-8d61-9e760f46323c-istiod-ca-cert\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.290961 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.290812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-credential-socket\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.290961 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.290845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-data\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.290961 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.290877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-certs\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.290961 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.290896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tsm\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-kube-api-access-p5tsm\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.290961 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.290918 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5112431-3560-4483-8d61-9e760f46323c-istio-podinfo\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.290961 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.290943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-envoy\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.291258 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.290982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-socket\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.291258 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.291084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-istio-token\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.291389 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.291357 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-certs\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.291503 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.291478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-credential-socket\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.291569 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.291497 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-data\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.291569 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.291498 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-socket\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.291569 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.291552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5112431-3560-4483-8d61-9e760f46323c-istiod-ca-cert\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.293431 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.293411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-envoy\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.293741 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.293725 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5112431-3560-4483-8d61-9e760f46323c-istio-podinfo\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.300675 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.300656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tsm\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-kube-api-access-p5tsm\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.300748 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.300673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-istio-token\") pod \"e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.394607 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.394521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:03.540758 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.540731 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278"] Jul 07 07:27:03.543439 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:27:03.543413 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5112431_3560_4483_8d61_9e760f46323c.slice/crio-8a631166cb5a648d2ae7383492877651d8979f657dca9fcc33b19e745651f599 WatchSource:0}: Error finding container 8a631166cb5a648d2ae7383492877651d8979f657dca9fcc33b19e745651f599: Status 404 returned error can't find the container with id 8a631166cb5a648d2ae7383492877651d8979f657dca9fcc33b19e745651f599 Jul 07 07:27:03.545988 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.545955 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:27:03.546072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.546026 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:27:03.546072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:03.546055 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:27:04.481993 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:04.481960 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" event={"ID":"a5112431-3560-4483-8d61-9e760f46323c","Type":"ContainerStarted","Data":"fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45"} Jul 07 07:27:04.482380 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:04.482015 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" event={"ID":"a5112431-3560-4483-8d61-9e760f46323c","Type":"ContainerStarted","Data":"8a631166cb5a648d2ae7383492877651d8979f657dca9fcc33b19e745651f599"} Jul 07 07:27:04.505559 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:04.505508 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" podStartSLOduration=1.505493005 podStartE2EDuration="1.505493005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:27:04.504791684 +0000 UTC m=+1697.930004953" watchObservedRunningTime="2026-07-07 07:27:04.505493005 +0000 UTC m=+1697.930706274" Jul 07 07:27:05.394920 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:05.394891 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:05.399677 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:05.399653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:05.488184 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:05.488153 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:05.489181 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:05.489165 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:10.693319 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:10.693230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:27:18.583116 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:18.583082 2565 generic.go:356] "Generic (PLEG): container finished" podID="a5112431-3560-4483-8d61-9e760f46323c" containerID="fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45" exitCode=0 Jul 07 07:27:18.583568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:18.583156 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" event={"ID":"a5112431-3560-4483-8d61-9e760f46323c","Type":"ContainerDied","Data":"fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45"} Jul 07 07:27:18.583568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:18.583518 2565 scope.go:117] "RemoveContainer" containerID="fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45" Jul 07 07:27:18.584665 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:18.584637 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:27:18.584735 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:18.584720 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:27:18.584787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:18.584771 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:27:19.590638 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:19.590577 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" event={"ID":"a5112431-3560-4483-8d61-9e760f46323c","Type":"ContainerStarted","Data":"29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171"} Jul 07 07:27:20.395485 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:20.395447 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:20.396714 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:20.396685 2565 patch_prober.go:28] interesting pod/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 07:27:20.396843 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:20.396739 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 07:27:20.488680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:20.488649 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:21.395769 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:21.395734 2565 patch_prober.go:28] interesting pod/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 07:27:21.396143 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:21.395789 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 07:27:22.395993 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:22.395957 2565 patch_prober.go:28] interesting pod/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 07:27:22.396391 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:22.396014 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 07:27:23.395571 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:23.395540 2565 patch_prober.go:28] interesting pod/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 07 07:27:23.395754 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:23.395609 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 07 07:27:24.399299 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:24.399268 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:24.400399 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:24.400378 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:27:24.886601 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:24.886546 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:27:51.288388 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:27:51.288351 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:28:05.883371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:05.883333 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:28:47.481118 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:47.481080 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:28:49.183549 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:49.183515 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278"] Jul 07 07:28:49.183987 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:49.183755 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" containerID="cri-o://29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171" gracePeriod=30 Jul 07 07:28:54.446158 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.446088 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:28:54.565492 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565462 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-istio-token\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.565680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565518 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5112431-3560-4483-8d61-9e760f46323c-istiod-ca-cert\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.565680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565561 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-envoy\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.565680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565624 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-data\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.565680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565641 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-certs\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.565680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565663 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5tsm\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-kube-api-access-p5tsm\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.565954 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565729 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5112431-3560-4483-8d61-9e760f46323c-istio-podinfo\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.565954 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565759 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-socket\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.565954 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565797 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-credential-socket\") pod \"a5112431-3560-4483-8d61-9e760f46323c\" (UID: \"a5112431-3560-4483-8d61-9e760f46323c\") " Jul 07 07:28:54.566112 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.565988 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:28:54.566112 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.566039 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5112431-3560-4483-8d61-9e760f46323c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:28:54.566217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.566158 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:28:54.566217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.566169 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5112431-3560-4483-8d61-9e760f46323c-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:54.566217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.566189 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:54.566364 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.566233 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:28:54.566524 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.566501 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:28:54.567874 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.567843 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5112431-3560-4483-8d61-9e760f46323c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:28:54.567999 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.567981 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:28:54.568163 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.568143 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-kube-api-access-p5tsm" (OuterVolumeSpecName: "kube-api-access-p5tsm") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "kube-api-access-p5tsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:28:54.568218 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.568174 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5112431-3560-4483-8d61-9e760f46323c" (UID: "a5112431-3560-4483-8d61-9e760f46323c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:28:54.667658 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.667627 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:54.667658 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.667654 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5tsm\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-kube-api-access-p5tsm\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:54.667658 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.667664 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5112431-3560-4483-8d61-9e760f46323c-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:54.667935 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.667674 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:54.667935 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.667682 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:54.667935 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.667690 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5112431-3560-4483-8d61-9e760f46323c-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:54.667935 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:54.667698 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5112431-3560-4483-8d61-9e760f46323c-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:28:55.133721 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.133686 2565 generic.go:356] "Generic (PLEG): container finished" podID="a5112431-3560-4483-8d61-9e760f46323c" containerID="29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171" exitCode=0 Jul 07 07:28:55.133871 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.133790 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" Jul 07 07:28:55.134140 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.134109 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" event={"ID":"a5112431-3560-4483-8d61-9e760f46323c","Type":"ContainerDied","Data":"29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171"} Jul 07 07:28:55.134224 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.134157 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" event={"ID":"a5112431-3560-4483-8d61-9e760f46323c","Type":"ContainerDied","Data":"8a631166cb5a648d2ae7383492877651d8979f657dca9fcc33b19e745651f599"} Jul 07 07:28:55.134224 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.134190 2565 scope.go:117] "RemoveContainer" containerID="29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171" Jul 07 07:28:55.147542 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.147514 2565 scope.go:117] "RemoveContainer" containerID="fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45" Jul 07 07:28:55.159638 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.159620 2565 scope.go:117] "RemoveContainer" containerID="29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171" Jul 07 07:28:55.159910 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:28:55.159889 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171\": container with ID starting with 29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171 not found: ID does not exist" containerID="29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171" Jul 07 07:28:55.159971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.159919 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171"} err="failed to get container status \"29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171\": rpc error: code = NotFound desc = could not find container \"29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171\": container with ID starting with 29c96b4cb1f2e9cc5528272e790a967e588353e0a76c455626f34c180fddf171 not found: ID does not exist" Jul 07 07:28:55.159971 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.159937 2565 scope.go:117] "RemoveContainer" containerID="fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45" Jul 07 07:28:55.160191 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:28:55.160173 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45\": container with ID starting with fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45 not found: ID does not exist" containerID="fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45" Jul 07 07:28:55.160232 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.160196 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45"} err="failed to get container status \"fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45\": rpc error: code = NotFound desc = could not find container \"fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45\": container with ID starting with fb6ed3f3f3aa22f72ff0e3e495858bb5cd0741638a3236e5eecef9a96360cc45 not found: ID does not exist" Jul 07 07:28:55.167963 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.167941 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278"] Jul 07 07:28:55.172451 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.172423 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278"] Jul 07 07:28:55.400983 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.400883 2565 patch_prober.go:28] interesting pod/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 07:28:55.400983 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:55.400952 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-18ebf0cb-openshift-default-59cb8b9775-9n278" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 07:28:57.135921 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:57.135891 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5112431-3560-4483-8d61-9e760f46323c" path="/var/lib/kubelet/pods/a5112431-3560-4483-8d61-9e760f46323c/volumes" Jul 07 07:28:59.487555 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:28:59.487521 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:29:07.179225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:07.179191 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:29:45.112039 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112003 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh"] Jul 07 07:29:45.112510 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112416 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" Jul 07 07:29:45.112510 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112427 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb6327b-2bff-4213-ade7-124b3739fe3e" containerName="istio-proxy" Jul 07 07:29:45.112510 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112435 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" Jul 07 07:29:45.112510 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112441 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" Jul 07 07:29:45.112510 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112465 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" Jul 07 07:29:45.112510 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112471 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" Jul 07 07:29:45.112724 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112539 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" Jul 07 07:29:45.112724 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.112545 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5112431-3560-4483-8d61-9e760f46323c" containerName="istio-proxy" Jul 07 07:29:45.115869 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.115853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.119764 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.119741 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ebf5a0-openshift-default-dockercfg-r6xdv\"" Jul 07 07:29:45.136565 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.136532 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh"] Jul 07 07:29:45.246432 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-envoy\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.246636 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01f492d-dd91-452c-bb80-62c127b146ea-istiod-ca-cert\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.246636 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw5jc\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-kube-api-access-qw5jc\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.246636 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-istio-token\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.246636 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01f492d-dd91-452c-bb80-62c127b146ea-istio-podinfo\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.246636 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246617 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-socket\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.246842 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-data\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.246842 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-certs\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.246842 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.246767 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-credential-socket\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348023 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.347985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01f492d-dd91-452c-bb80-62c127b146ea-istiod-ca-cert\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw5jc\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-kube-api-access-qw5jc\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-istio-token\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348071 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01f492d-dd91-452c-bb80-62c127b146ea-istio-podinfo\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-socket\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-data\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348144 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-certs\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-credential-socket\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348646 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348261 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-envoy\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348709 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348658 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-credential-socket\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348709 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-certs\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348709 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348658 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-socket\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348816 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-data\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.348919 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.348899 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01f492d-dd91-452c-bb80-62c127b146ea-istiod-ca-cert\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.350751 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.350723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-envoy\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.350931 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.350913 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01f492d-dd91-452c-bb80-62c127b146ea-istio-podinfo\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.357968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.357942 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-istio-token\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.359800 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.359778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw5jc\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-kube-api-access-qw5jc\") pod \"e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.426857 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.426764 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:45.570489 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.570463 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh"] Jul 07 07:29:45.572199 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:29:45.572159 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01f492d_dd91_452c_bb80_62c127b146ea.slice/crio-7d68e0cec6c333eed46d2e7bc244a336cdda1ad10e5ff0883a9f2102c65f67a6 WatchSource:0}: Error finding container 7d68e0cec6c333eed46d2e7bc244a336cdda1ad10e5ff0883a9f2102c65f67a6: Status 404 returned error can't find the container with id 7d68e0cec6c333eed46d2e7bc244a336cdda1ad10e5ff0883a9f2102c65f67a6 Jul 07 07:29:45.574283 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.574244 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:29:45.574388 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.574315 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:29:45.574388 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:45.574341 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:29:46.432406 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:46.432372 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" event={"ID":"c01f492d-dd91-452c-bb80-62c127b146ea","Type":"ContainerStarted","Data":"5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8"} Jul 07 07:29:46.432852 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:46.432422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" event={"ID":"c01f492d-dd91-452c-bb80-62c127b146ea","Type":"ContainerStarted","Data":"7d68e0cec6c333eed46d2e7bc244a336cdda1ad10e5ff0883a9f2102c65f67a6"} Jul 07 07:29:46.457087 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:46.457035 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" podStartSLOduration=1.457020408 podStartE2EDuration="1.457020408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:29:46.454277561 +0000 UTC m=+1859.879490854" watchObservedRunningTime="2026-07-07 07:29:46.457020408 +0000 UTC m=+1859.882233677" Jul 07 07:29:47.427879 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:47.427850 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:47.433436 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:47.433410 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:47.437781 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:47.437762 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:47.438494 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:47.438478 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:29:53.520323 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.519897 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:29:53.531870 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.531839 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7"] Jul 07 07:29:53.535628 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.535609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.538175 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.538160 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e309b3-openshift-default-dockercfg-2ktpr\"" Jul 07 07:29:53.548880 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.548859 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7"] Jul 07 07:29:53.633789 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.633754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-podinfo\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.633989 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.633856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-credential-socket\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.633989 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.633884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-token\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.633989 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.633937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-envoy\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.634162 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.634065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t967\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-kube-api-access-6t967\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.634162 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.634142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istiod-ca-cert\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.634266 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.634175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-certs\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.634331 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.634272 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-socket\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.634388 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.634363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-data\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.735680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-certs\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.735865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735707 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-socket\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.735865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-data\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.735865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-podinfo\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.735865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-credential-socket\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.735865 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-token\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.736131 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-envoy\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.736131 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t967\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-kube-api-access-6t967\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.736131 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.735936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istiod-ca-cert\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.736131 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.736105 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-certs\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.736329 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.736210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-data\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.736379 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.736348 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-credential-socket\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.736414 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.736374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-socket\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.736685 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.736665 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istiod-ca-cert\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.738231 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.738203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-envoy\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.738336 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.738321 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-podinfo\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.745641 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.745615 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t967\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-kube-api-access-6t967\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.745641 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.745628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-token\") pod \"e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.846902 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.846868 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:53.994879 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.994853 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7"] Jul 07 07:29:53.996950 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:29:53.996923 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ff9244_ac6e_4c3b_a7d2_e98359461c4c.slice/crio-197921974c473f6f4b7ceef4c4ca95243c738e9cd41dcd8e5b49948aec64514c WatchSource:0}: Error finding container 197921974c473f6f4b7ceef4c4ca95243c738e9cd41dcd8e5b49948aec64514c: Status 404 returned error can't find the container with id 197921974c473f6f4b7ceef4c4ca95243c738e9cd41dcd8e5b49948aec64514c Jul 07 07:29:53.999058 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.999024 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:29:53.999153 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.999090 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:29:53.999153 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:53.999116 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:29:54.480911 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:54.480870 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" event={"ID":"16ff9244-ac6e-4c3b-a7d2-e98359461c4c","Type":"ContainerStarted","Data":"41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2"} Jul 07 07:29:54.481130 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:54.480939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" event={"ID":"16ff9244-ac6e-4c3b-a7d2-e98359461c4c","Type":"ContainerStarted","Data":"197921974c473f6f4b7ceef4c4ca95243c738e9cd41dcd8e5b49948aec64514c"} Jul 07 07:29:54.504455 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:54.504402 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" podStartSLOduration=1.504384993 podStartE2EDuration="1.504384993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:29:54.502775173 +0000 UTC m=+1867.927988441" watchObservedRunningTime="2026-07-07 07:29:54.504384993 +0000 UTC m=+1867.929598262" Jul 07 07:29:54.847242 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:54.847195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:55.852563 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:55.852533 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:56.492472 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:56.492444 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:29:56.493399 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:29:56.493382 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:30:00.138232 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.138192 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5"] Jul 07 07:30:00.143421 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.143341 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb"] Jul 07 07:30:00.143649 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.143526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" Jul 07 07:30:00.146085 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.146052 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-z6nck\"" Jul 07 07:30:00.148329 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.148172 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" Jul 07 07:30:00.148538 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.148492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb"] Jul 07 07:30:00.153979 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.153949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5"] Jul 07 07:30:00.202452 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.202417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55t2k\" (UniqueName: \"kubernetes.io/projected/1e862b03-e093-44be-b63d-a8fc8e58c042-kube-api-access-55t2k\") pod \"maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5\" (UID: \"1e862b03-e093-44be-b63d-a8fc8e58c042\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" Jul 07 07:30:00.202635 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.202536 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2v8n\" (UniqueName: \"kubernetes.io/projected/8d581526-2c03-40db-bccb-c7acb5bf2b99-kube-api-access-v2v8n\") pod \"maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb\" (UID: \"8d581526-2c03-40db-bccb-c7acb5bf2b99\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" Jul 07 07:30:00.303358 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.303322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55t2k\" (UniqueName: \"kubernetes.io/projected/1e862b03-e093-44be-b63d-a8fc8e58c042-kube-api-access-55t2k\") pod \"maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5\" (UID: \"1e862b03-e093-44be-b63d-a8fc8e58c042\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" Jul 07 07:30:00.303524 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.303393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2v8n\" (UniqueName: \"kubernetes.io/projected/8d581526-2c03-40db-bccb-c7acb5bf2b99-kube-api-access-v2v8n\") pod \"maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb\" (UID: \"8d581526-2c03-40db-bccb-c7acb5bf2b99\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" Jul 07 07:30:00.312614 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.312553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2v8n\" (UniqueName: \"kubernetes.io/projected/8d581526-2c03-40db-bccb-c7acb5bf2b99-kube-api-access-v2v8n\") pod \"maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb\" (UID: \"8d581526-2c03-40db-bccb-c7acb5bf2b99\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" Jul 07 07:30:00.312744 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.312728 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55t2k\" (UniqueName: \"kubernetes.io/projected/1e862b03-e093-44be-b63d-a8fc8e58c042-kube-api-access-55t2k\") pod \"maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5\" (UID: \"1e862b03-e093-44be-b63d-a8fc8e58c042\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" Jul 07 07:30:00.467050 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.466969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" Jul 07 07:30:00.473657 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.473629 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" Jul 07 07:30:00.653423 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.653391 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5"] Jul 07 07:30:00.654749 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:30:00.654720 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e862b03_e093_44be_b63d_a8fc8e58c042.slice/crio-a54a0a0aeb0abbaba6149f362366f709111a88fa7c06b84f24de394001abff5e WatchSource:0}: Error finding container a54a0a0aeb0abbaba6149f362366f709111a88fa7c06b84f24de394001abff5e: Status 404 returned error can't find the container with id a54a0a0aeb0abbaba6149f362366f709111a88fa7c06b84f24de394001abff5e Jul 07 07:30:00.669686 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:00.669664 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb"] Jul 07 07:30:00.673424 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:30:00.673391 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d581526_2c03_40db_bccb_c7acb5bf2b99.slice/crio-b6cf872cf43e2e704b0d7068d204b1476916666a6d0cba393904258c9cb13d94 WatchSource:0}: Error finding container b6cf872cf43e2e704b0d7068d204b1476916666a6d0cba393904258c9cb13d94: Status 404 returned error can't find the container with id b6cf872cf43e2e704b0d7068d204b1476916666a6d0cba393904258c9cb13d94 Jul 07 07:30:01.527791 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:01.526918 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" event={"ID":"1e862b03-e093-44be-b63d-a8fc8e58c042","Type":"ContainerStarted","Data":"d037976caa0578ba0c7cf9b76fe5540922dc2cf9f3709cb064270f9a0fe570f5"} Jul 07 07:30:01.527791 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:01.527000 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" event={"ID":"1e862b03-e093-44be-b63d-a8fc8e58c042","Type":"ContainerStarted","Data":"a54a0a0aeb0abbaba6149f362366f709111a88fa7c06b84f24de394001abff5e"} Jul 07 07:30:01.533141 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:01.533108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" event={"ID":"8d581526-2c03-40db-bccb-c7acb5bf2b99","Type":"ContainerStarted","Data":"17a99783846736fcea9c3013cb98fa95823ed16b0375278103d3e3ace1642735"} Jul 07 07:30:01.533711 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:01.533686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" event={"ID":"8d581526-2c03-40db-bccb-c7acb5bf2b99","Type":"ContainerStarted","Data":"b6cf872cf43e2e704b0d7068d204b1476916666a6d0cba393904258c9cb13d94"} Jul 07 07:30:01.568347 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:01.568289 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" podStartSLOduration=1.568269249 podStartE2EDuration="1.568269249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:30:01.567458579 +0000 UTC m=+1874.992671848" watchObservedRunningTime="2026-07-07 07:30:01.568269249 +0000 UTC m=+1874.993482547" Jul 07 07:30:01.569492 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:01.569457 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" podStartSLOduration=1.569445627 podStartE2EDuration="1.569445627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:30:01.548800987 +0000 UTC m=+1874.974014257" watchObservedRunningTime="2026-07-07 07:30:01.569445627 +0000 UTC m=+1874.994659085" Jul 07 07:30:02.440042 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.439993 2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 07:30:02.440308 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.440065 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 07:30:02.546923 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.546836 2565 generic.go:356] "Generic (PLEG): container finished" podID="c01f492d-dd91-452c-bb80-62c127b146ea" containerID="5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8" exitCode=0 Jul 07 07:30:02.547409 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.546942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" event={"ID":"c01f492d-dd91-452c-bb80-62c127b146ea","Type":"ContainerDied","Data":"5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8"} Jul 07 07:30:02.547499 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.547460 2565 scope.go:117] "RemoveContainer" containerID="5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8" Jul 07 07:30:02.549117 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.549052 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:30:02.549259 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.549141 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:30:02.549259 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.549179 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:30:02.549494 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.549471 2565 generic.go:356] "Generic (PLEG): container finished" podID="8d581526-2c03-40db-bccb-c7acb5bf2b99" containerID="17a99783846736fcea9c3013cb98fa95823ed16b0375278103d3e3ace1642735" exitCode=0 Jul 07 07:30:02.549564 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.549544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" event={"ID":"8d581526-2c03-40db-bccb-c7acb5bf2b99","Type":"ContainerDied","Data":"17a99783846736fcea9c3013cb98fa95823ed16b0375278103d3e3ace1642735"} Jul 07 07:30:02.551063 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.551041 2565 generic.go:356] "Generic (PLEG): container finished" podID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerID="d037976caa0578ba0c7cf9b76fe5540922dc2cf9f3709cb064270f9a0fe570f5" exitCode=7 Jul 07 07:30:02.551169 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.551110 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" event={"ID":"1e862b03-e093-44be-b63d-a8fc8e58c042","Type":"ContainerDied","Data":"d037976caa0578ba0c7cf9b76fe5540922dc2cf9f3709cb064270f9a0fe570f5"} Jul 07 07:30:02.551254 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:02.551234 2565 scope.go:117] "RemoveContainer" containerID="d037976caa0578ba0c7cf9b76fe5540922dc2cf9f3709cb064270f9a0fe570f5" Jul 07 07:30:03.563880 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.563832 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" event={"ID":"c01f492d-dd91-452c-bb80-62c127b146ea","Type":"ContainerStarted","Data":"d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9"} Jul 07 07:30:03.566959 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.566920 2565 generic.go:356] "Generic (PLEG): container finished" podID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerID="dabb67192ebbed677f9d1693d8b17a39098050d6cedc537ab2e25bf35e700228" exitCode=7 Jul 07 07:30:03.567451 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.567428 2565 scope.go:117] "RemoveContainer" containerID="dabb67192ebbed677f9d1693d8b17a39098050d6cedc537ab2e25bf35e700228" Jul 07 07:30:03.567755 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:30:03.567727 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5_opendatahub(1e862b03-e093-44be-b63d-a8fc8e58c042)\"" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" Jul 07 07:30:03.568003 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.567975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" event={"ID":"1e862b03-e093-44be-b63d-a8fc8e58c042","Type":"ContainerDied","Data":"dabb67192ebbed677f9d1693d8b17a39098050d6cedc537ab2e25bf35e700228"} Jul 07 07:30:03.568096 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.568041 2565 scope.go:117] "RemoveContainer" containerID="d037976caa0578ba0c7cf9b76fe5540922dc2cf9f3709cb064270f9a0fe570f5" Jul 07 07:30:03.802843 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.802819 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" Jul 07 07:30:03.875049 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.873030 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2v8n\" (UniqueName: \"kubernetes.io/projected/8d581526-2c03-40db-bccb-c7acb5bf2b99-kube-api-access-v2v8n\") pod \"8d581526-2c03-40db-bccb-c7acb5bf2b99\" (UID: \"8d581526-2c03-40db-bccb-c7acb5bf2b99\") " Jul 07 07:30:03.877860 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.877821 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d581526-2c03-40db-bccb-c7acb5bf2b99-kube-api-access-v2v8n" (OuterVolumeSpecName: "kube-api-access-v2v8n") pod "8d581526-2c03-40db-bccb-c7acb5bf2b99" (UID: "8d581526-2c03-40db-bccb-c7acb5bf2b99"). InnerVolumeSpecName "kube-api-access-v2v8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:30:03.974327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:03.974220 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2v8n\" (UniqueName: \"kubernetes.io/projected/8d581526-2c03-40db-bccb-c7acb5bf2b99-kube-api-access-v2v8n\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:30:04.428175 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:04.427917 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:30:04.428394 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:04.428215 2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 07:30:04.428394 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:04.428268 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 07:30:04.577031 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:04.576999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" event={"ID":"8d581526-2c03-40db-bccb-c7acb5bf2b99","Type":"ContainerDied","Data":"b6cf872cf43e2e704b0d7068d204b1476916666a6d0cba393904258c9cb13d94"} Jul 07 07:30:04.577450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:04.577048 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6cf872cf43e2e704b0d7068d204b1476916666a6d0cba393904258c9cb13d94" Jul 07 07:30:04.577450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:04.577096 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb" Jul 07 07:30:04.579051 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:04.579029 2565 scope.go:117] "RemoveContainer" containerID="dabb67192ebbed677f9d1693d8b17a39098050d6cedc537ab2e25bf35e700228" Jul 07 07:30:04.579227 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:30:04.579206 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5_opendatahub(1e862b03-e093-44be-b63d-a8fc8e58c042)\"" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" Jul 07 07:30:05.428077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:05.427498 2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 07:30:05.428077 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:05.427602 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 07:30:06.428208 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:06.428162 2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 07:30:06.428736 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:06.428236 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 07:30:07.427932 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:07.427889 2565 patch_prober.go:28] interesting pod/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 07 07:30:07.428156 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:07.427968 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 07 07:30:08.431767 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.431725 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:30:08.432223 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.432207 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:30:08.433125 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.433103 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:30:08.603666 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.603631 2565 generic.go:356] "Generic (PLEG): container finished" podID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerID="41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2" exitCode=0 Jul 07 07:30:08.603844 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.603707 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" event={"ID":"16ff9244-ac6e-4c3b-a7d2-e98359461c4c","Type":"ContainerDied","Data":"41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2"} Jul 07 07:30:08.604248 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.604233 2565 scope.go:117] "RemoveContainer" containerID="41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2" Jul 07 07:30:08.605257 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.605223 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:30:08.605326 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.605312 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:30:08.605389 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:08.605378 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:30:09.291725 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:09.291638 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:30:09.611134 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:09.611093 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" event={"ID":"16ff9244-ac6e-4c3b-a7d2-e98359461c4c","Type":"ContainerStarted","Data":"56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4"} Jul 07 07:30:09.847752 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:09.847709 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:30:09.849173 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:09.849143 2565 patch_prober.go:28] interesting pod/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 07 07:30:09.849315 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:09.849195 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 07 07:30:10.848084 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:10.848044 2565 patch_prober.go:28] interesting pod/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 07 07:30:10.848618 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:10.848118 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 07 07:30:11.492628 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:11.492574 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:30:11.847432 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:11.847385 2565 patch_prober.go:28] interesting pod/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 07 07:30:11.847678 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:11.847455 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 07 07:30:12.848204 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:12.848163 2565 patch_prober.go:28] interesting pod/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 07 07:30:12.848709 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:12.848235 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 07 07:30:13.852138 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:13.852104 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:30:13.853211 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:13.853186 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:30:18.128523 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:18.128492 2565 scope.go:117] "RemoveContainer" containerID="dabb67192ebbed677f9d1693d8b17a39098050d6cedc537ab2e25bf35e700228" Jul 07 07:30:18.678804 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:18.678713 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" event={"ID":"1e862b03-e093-44be-b63d-a8fc8e58c042","Type":"ContainerStarted","Data":"aa1ebdeba57093f7e2e6006d1658c5bb2acef79f7572b50535db20c8b21fddcf"} Jul 07 07:30:19.686363 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:19.686330 2565 generic.go:356] "Generic (PLEG): container finished" podID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerID="aa1ebdeba57093f7e2e6006d1658c5bb2acef79f7572b50535db20c8b21fddcf" exitCode=0 Jul 07 07:30:19.686787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:19.686403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" event={"ID":"1e862b03-e093-44be-b63d-a8fc8e58c042","Type":"ContainerDied","Data":"aa1ebdeba57093f7e2e6006d1658c5bb2acef79f7572b50535db20c8b21fddcf"} Jul 07 07:30:19.686787 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:19.686466 2565 scope.go:117] "RemoveContainer" containerID="dabb67192ebbed677f9d1693d8b17a39098050d6cedc537ab2e25bf35e700228" Jul 07 07:30:19.718453 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:19.718431 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5"] Jul 07 07:30:20.832279 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:20.832253 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" Jul 07 07:30:20.954262 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:20.954174 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55t2k\" (UniqueName: \"kubernetes.io/projected/1e862b03-e093-44be-b63d-a8fc8e58c042-kube-api-access-55t2k\") pod \"1e862b03-e093-44be-b63d-a8fc8e58c042\" (UID: \"1e862b03-e093-44be-b63d-a8fc8e58c042\") " Jul 07 07:30:20.956202 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:20.956176 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e862b03-e093-44be-b63d-a8fc8e58c042-kube-api-access-55t2k" (OuterVolumeSpecName: "kube-api-access-55t2k") pod "1e862b03-e093-44be-b63d-a8fc8e58c042" (UID: "1e862b03-e093-44be-b63d-a8fc8e58c042"). InnerVolumeSpecName "kube-api-access-55t2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:30:21.055140 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:21.055107 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55t2k\" (UniqueName: \"kubernetes.io/projected/1e862b03-e093-44be-b63d-a8fc8e58c042-kube-api-access-55t2k\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:30:21.701237 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:21.701206 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" Jul 07 07:30:21.701453 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:21.701259 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5" event={"ID":"1e862b03-e093-44be-b63d-a8fc8e58c042","Type":"ContainerDied","Data":"a54a0a0aeb0abbaba6149f362366f709111a88fa7c06b84f24de394001abff5e"} Jul 07 07:30:21.701453 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:21.701314 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a54a0a0aeb0abbaba6149f362366f709111a88fa7c06b84f24de394001abff5e" Jul 07 07:30:21.737054 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:21.737025 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5"] Jul 07 07:30:21.745199 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:21.745164 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-e309b3-29723490-wqnz5"] Jul 07 07:30:22.482959 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:22.482923 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:30:23.134683 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:23.134649 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" path="/var/lib/kubelet/pods/1e862b03-e093-44be-b63d-a8fc8e58c042/volumes" Jul 07 07:30:32.587782 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:30:32.587749 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:31:08.391014 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:31:08.390979 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:31:23.484912 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:31:23.484877 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:31:27.306527 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:31:27.306486 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb"] Jul 07 07:31:27.309198 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:31:27.309173 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-ebf5a0-29723490-w6ztb"] Jul 07 07:31:29.133674 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:31:29.133641 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d581526-2c03-40db-bccb-c7acb5bf2b99" path="/var/lib/kubelet/pods/8d581526-2c03-40db-bccb-c7acb5bf2b99/volumes" Jul 07 07:31:37.795282 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:31:37.795247 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:32:09.259747 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:09.259662 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh"] Jul 07 07:32:09.260313 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:09.259942 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" containerID="cri-o://d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9" gracePeriod=30 Jul 07 07:32:13.077314 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:13.077282 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:32:14.523656 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.523573 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:32:14.649446 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649404 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01f492d-dd91-452c-bb80-62c127b146ea-istiod-ca-cert\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.649446 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649449 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw5jc\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-kube-api-access-qw5jc\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.649747 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649492 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-istio-token\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.649747 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649554 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-credential-socket\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.649747 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649614 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-data\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.649747 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649652 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01f492d-dd91-452c-bb80-62c127b146ea-istio-podinfo\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.649747 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649686 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-envoy\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.649747 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649745 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-certs\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.650067 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-socket\") pod \"c01f492d-dd91-452c-bb80-62c127b146ea\" (UID: \"c01f492d-dd91-452c-bb80-62c127b146ea\") " Jul 07 07:32:14.650067 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649919 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c01f492d-dd91-452c-bb80-62c127b146ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:32:14.650067 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.649933 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:14.650225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.650130 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:14.650225 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.650139 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:14.650331 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.650302 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:14.650390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.650338 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:14.650390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.650352 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c01f492d-dd91-452c-bb80-62c127b146ea-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:14.650390 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.650365 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:14.650808 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.650778 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:14.651975 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.651943 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:14.651975 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.651949 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-kube-api-access-qw5jc" (OuterVolumeSpecName: "kube-api-access-qw5jc") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "kube-api-access-qw5jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:32:14.652117 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.652001 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:32:14.652117 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.652035 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c01f492d-dd91-452c-bb80-62c127b146ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c01f492d-dd91-452c-bb80-62c127b146ea" (UID: "c01f492d-dd91-452c-bb80-62c127b146ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:32:14.751807 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.751765 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw5jc\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-kube-api-access-qw5jc\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:14.751807 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.751801 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01f492d-dd91-452c-bb80-62c127b146ea-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:14.751807 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.751811 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:14.751807 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.751819 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c01f492d-dd91-452c-bb80-62c127b146ea-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:14.752087 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:14.751827 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c01f492d-dd91-452c-bb80-62c127b146ea-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:15.361804 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.361773 2565 generic.go:356] "Generic (PLEG): container finished" podID="c01f492d-dd91-452c-bb80-62c127b146ea" containerID="d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9" exitCode=0 Jul 07 07:32:15.362018 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.361823 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" Jul 07 07:32:15.362018 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.361859 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" event={"ID":"c01f492d-dd91-452c-bb80-62c127b146ea","Type":"ContainerDied","Data":"d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9"} Jul 07 07:32:15.362018 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.361913 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh" event={"ID":"c01f492d-dd91-452c-bb80-62c127b146ea","Type":"ContainerDied","Data":"7d68e0cec6c333eed46d2e7bc244a336cdda1ad10e5ff0883a9f2102c65f67a6"} Jul 07 07:32:15.362018 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.361942 2565 scope.go:117] "RemoveContainer" containerID="d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9" Jul 07 07:32:15.373502 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.373479 2565 scope.go:117] "RemoveContainer" containerID="5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8" Jul 07 07:32:15.382213 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.382052 2565 scope.go:117] "RemoveContainer" containerID="d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9" Jul 07 07:32:15.382336 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:32:15.382316 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9\": container with ID starting with d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9 not found: ID does not exist" containerID="d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9" Jul 07 07:32:15.382386 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.382351 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9"} err="failed to get container status \"d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9\": rpc error: code = NotFound desc = could not find container \"d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9\": container with ID starting with d00637910c2c4ee86d96967ad39bb10368b3d4e29046dc0eaa7dc65d811d16a9 not found: ID does not exist" Jul 07 07:32:15.382386 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.382371 2565 scope.go:117] "RemoveContainer" containerID="5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8" Jul 07 07:32:15.382644 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:32:15.382619 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8\": container with ID starting with 5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8 not found: ID does not exist" containerID="5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8" Jul 07 07:32:15.382711 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.382665 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8"} err="failed to get container status \"5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8\": rpc error: code = NotFound desc = could not find container \"5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8\": container with ID starting with 5563e83655d4f8ca9955a9fb448f750ba06a37d6e60005bf5e047944e655aab8 not found: ID does not exist" Jul 07 07:32:15.386398 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.386370 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh"] Jul 07 07:32:15.390651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:15.390626 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ebf5a0-openshift-default-6cbcd76b4c-zqwhh"] Jul 07 07:32:16.738570 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:16.738528 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7"] Jul 07 07:32:16.738964 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:16.738807 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" containerID="cri-o://56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4" gracePeriod=30 Jul 07 07:32:17.134186 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.134153 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" path="/var/lib/kubelet/pods/c01f492d-dd91-452c-bb80-62c127b146ea/volumes" Jul 07 07:32:17.652630 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.652593 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99"] Jul 07 07:32:17.653207 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653190 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:17.653207 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653209 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:17.653327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653218 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" Jul 07 07:32:17.653327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653224 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" Jul 07 07:32:17.653327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653249 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d581526-2c03-40db-bccb-c7acb5bf2b99" containerName="cleanup" Jul 07 07:32:17.653327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653256 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d581526-2c03-40db-bccb-c7acb5bf2b99" containerName="cleanup" Jul 07 07:32:17.653327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653267 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:17.653327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653272 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:17.653327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653279 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:17.653327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653284 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:17.653568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653346 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:17.653568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653356 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" Jul 07 07:32:17.653568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653362 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d581526-2c03-40db-bccb-c7acb5bf2b99" containerName="cleanup" Jul 07 07:32:17.653568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653368 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" Jul 07 07:32:17.653568 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.653375 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:17.657953 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.657935 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.660332 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.660314 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-14bf96-openshift-default-dockercfg-s4zp8\"" Jul 07 07:32:17.669167 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.669144 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99"] Jul 07 07:32:17.782134 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istiod-ca-cert\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.782651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwlwk\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-kube-api-access-xwlwk\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.782651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-podinfo\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.782651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782250 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-token\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.782651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-envoy\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.782651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-credential-socket\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.782651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-data\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.782651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-certs\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.782651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.782547 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-socket\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.883721 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.883684 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-socket\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.883913 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.883750 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istiod-ca-cert\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.883913 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.883779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwlwk\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-kube-api-access-xwlwk\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.883913 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.883806 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-podinfo\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.883913 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.883857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-token\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.883924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-envoy\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.883963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-credential-socket\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.883992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-data\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.884090 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-socket\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884137 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.884125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-certs\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884395 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.884305 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-credential-socket\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884395 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.884342 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-data\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884506 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.884483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-certs\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.884681 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.884663 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istiod-ca-cert\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.886246 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.886226 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-envoy\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.886334 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.886306 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-podinfo\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.892695 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.892673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-token\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.892874 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.892856 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwlwk\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-kube-api-access-xwlwk\") pod \"e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:17.969844 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:17.969747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:18.114676 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:18.114638 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99"] Jul 07 07:32:18.116478 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:32:18.116455 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6e0f10_7bfd_4d49_82db_217e46a2b375.slice/crio-7d87c74e4baafbb7970ca6568a5fddaf04d2a522fbdf4cac62a2d415561c4928 WatchSource:0}: Error finding container 7d87c74e4baafbb7970ca6568a5fddaf04d2a522fbdf4cac62a2d415561c4928: Status 404 returned error can't find the container with id 7d87c74e4baafbb7970ca6568a5fddaf04d2a522fbdf4cac62a2d415561c4928 Jul 07 07:32:18.118765 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:18.118731 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:18.118839 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:18.118814 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:18.118894 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:18.118879 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:18.386188 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:18.386152 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" event={"ID":"ec6e0f10-7bfd-4d49-82db-217e46a2b375","Type":"ContainerStarted","Data":"ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0"} Jul 07 07:32:18.386387 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:18.386254 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" event={"ID":"ec6e0f10-7bfd-4d49-82db-217e46a2b375","Type":"ContainerStarted","Data":"7d87c74e4baafbb7970ca6568a5fddaf04d2a522fbdf4cac62a2d415561c4928"} Jul 07 07:32:18.408292 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:18.408242 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" podStartSLOduration=1.408224765 podStartE2EDuration="1.408224765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:32:18.40755942 +0000 UTC m=+2011.832772690" watchObservedRunningTime="2026-07-07 07:32:18.408224765 +0000 UTC m=+2011.833438032" Jul 07 07:32:18.970394 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:18.970305 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:19.974903 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:19.974873 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:20.399062 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:20.399035 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:20.400155 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:20.400058 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:21.992744 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:21.992718 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:32:22.020898 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.020818 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-socket\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.020898 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.020861 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-certs\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.020898 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.020886 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-token\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.021170 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.020912 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-envoy\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.021170 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.020947 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-credential-socket\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.021170 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.020970 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-data\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.021170 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.021012 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istiod-ca-cert\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.021170 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.021053 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t967\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-kube-api-access-6t967\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.021431 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.021170 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-podinfo\") pod \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\" (UID: \"16ff9244-ac6e-4c3b-a7d2-e98359461c4c\") " Jul 07 07:32:22.021504 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.021476 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:32:22.021810 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.021781 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:22.022356 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.022306 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:22.024051 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.022573 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:22.024051 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.022675 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:22.026012 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.025985 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:32:22.026125 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.026005 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:32:22.026343 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.026325 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:22.026425 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.026350 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-kube-api-access-6t967" (OuterVolumeSpecName: "kube-api-access-6t967") pod "16ff9244-ac6e-4c3b-a7d2-e98359461c4c" (UID: "16ff9244-ac6e-4c3b-a7d2-e98359461c4c"). InnerVolumeSpecName "kube-api-access-6t967". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:32:22.122003 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.121966 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.122003 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.122000 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.122217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.122016 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.122217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.122028 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.122217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.122039 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.122217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.122051 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.122217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.122061 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.122217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.122073 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.122217 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.122084 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t967\" (UniqueName: \"kubernetes.io/projected/16ff9244-ac6e-4c3b-a7d2-e98359461c4c-kube-api-access-6t967\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:22.413147 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.413112 2565 generic.go:356] "Generic (PLEG): container finished" podID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerID="56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4" exitCode=0 Jul 07 07:32:22.413342 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.413161 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" Jul 07 07:32:22.413342 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.413198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" event={"ID":"16ff9244-ac6e-4c3b-a7d2-e98359461c4c","Type":"ContainerDied","Data":"56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4"} Jul 07 07:32:22.413342 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.413260 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7" event={"ID":"16ff9244-ac6e-4c3b-a7d2-e98359461c4c","Type":"ContainerDied","Data":"197921974c473f6f4b7ceef4c4ca95243c738e9cd41dcd8e5b49948aec64514c"} Jul 07 07:32:22.413342 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.413288 2565 scope.go:117] "RemoveContainer" containerID="56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4" Jul 07 07:32:22.423828 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.423805 2565 scope.go:117] "RemoveContainer" containerID="41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2" Jul 07 07:32:22.434710 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.434687 2565 scope.go:117] "RemoveContainer" containerID="56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4" Jul 07 07:32:22.435040 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:32:22.435019 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4\": container with ID starting with 56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4 not found: ID does not exist" containerID="56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4" Jul 07 07:32:22.435141 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.435052 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4"} err="failed to get container status \"56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4\": rpc error: code = NotFound desc = could not find container \"56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4\": container with ID starting with 56375c8bf790f25e324b5d65514632a74146c652f638d0aed91bf93a7a2e46c4 not found: ID does not exist" Jul 07 07:32:22.435141 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.435077 2565 scope.go:117] "RemoveContainer" containerID="41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2" Jul 07 07:32:22.435378 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:32:22.435354 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2\": container with ID starting with 41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2 not found: ID does not exist" containerID="41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2" Jul 07 07:32:22.435422 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.435388 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2"} err="failed to get container status \"41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2\": rpc error: code = NotFound desc = could not find container \"41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2\": container with ID starting with 41ba586672fa032eefd96737d97facc8e5e338c43eb5ef20704cae89026134e2 not found: ID does not exist" Jul 07 07:32:22.437314 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.437296 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7"] Jul 07 07:32:22.441742 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:22.441720 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e309b3-openshift-default-6999488947-f5hs7"] Jul 07 07:32:23.134563 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:23.134524 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" path="/var/lib/kubelet/pods/16ff9244-ac6e-4c3b-a7d2-e98359461c4c/volumes" Jul 07 07:32:25.546903 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.546869 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5"] Jul 07 07:32:25.547510 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547486 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" Jul 07 07:32:25.547615 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547513 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c01f492d-dd91-452c-bb80-62c127b146ea" containerName="istio-proxy" Jul 07 07:32:25.547615 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547546 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" Jul 07 07:32:25.547615 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547554 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" Jul 07 07:32:25.547615 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547574 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" Jul 07 07:32:25.547615 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547597 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" Jul 07 07:32:25.547806 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547687 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e862b03-e093-44be-b63d-a8fc8e58c042" containerName="cleanup" Jul 07 07:32:25.547806 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547697 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" Jul 07 07:32:25.547806 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.547704 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ff9244-ac6e-4c3b-a7d2-e98359461c4c" containerName="istio-proxy" Jul 07 07:32:25.552142 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.552125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.554788 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.554766 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5b2516-openshift-default-dockercfg-crfxq\"" Jul 07 07:32:25.563734 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.563709 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5"] Jul 07 07:32:25.655988 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.655950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-socket\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.656191 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.656002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d56d2b89-892e-448c-812b-9c9331390608-istiod-ca-cert\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.656191 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.656037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-credential-socket\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.656191 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.656097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8wk\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-kube-api-access-zz8wk\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.656191 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.656166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-istio-token\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.656407 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.656212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-envoy\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.656407 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.656241 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d56d2b89-892e-448c-812b-9c9331390608-istio-podinfo\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.656407 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.656309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-certs\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.656407 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.656360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-data\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.757807 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.757772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-credential-socket\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.757825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8wk\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-kube-api-access-zz8wk\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.757853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-istio-token\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.757876 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-envoy\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.757895 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d56d2b89-892e-448c-812b-9c9331390608-istio-podinfo\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.757916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-certs\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.757938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-data\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.758001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-socket\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.758032 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d56d2b89-892e-448c-812b-9c9331390608-istiod-ca-cert\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758371 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.758220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-credential-socket\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758842 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.758483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-certs\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758842 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.758529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-data\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758842 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.758571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-socket\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.758947 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.758849 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d56d2b89-892e-448c-812b-9c9331390608-istiod-ca-cert\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.760304 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.760274 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-envoy\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.760414 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.760389 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d56d2b89-892e-448c-812b-9c9331390608-istio-podinfo\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.766047 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.766019 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-istio-token\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.766214 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.766197 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8wk\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-kube-api-access-zz8wk\") pod \"e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:25.862980 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:25.862947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:26.008450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.008421 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5"] Jul 07 07:32:26.009430 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:32:26.009409 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56d2b89_892e_448c_812b_9c9331390608.slice/crio-e03a3c59321183cc6c1fa364bc03bbbbde67f98d9f79d401ce19d830af50f9b7 WatchSource:0}: Error finding container e03a3c59321183cc6c1fa364bc03bbbbde67f98d9f79d401ce19d830af50f9b7: Status 404 returned error can't find the container with id e03a3c59321183cc6c1fa364bc03bbbbde67f98d9f79d401ce19d830af50f9b7 Jul 07 07:32:26.011563 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.011535 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:26.011676 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.011620 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:26.011676 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.011665 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:26.189165 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.189069 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:32:26.442169 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.442057 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" event={"ID":"d56d2b89-892e-448c-812b-9c9331390608","Type":"ContainerStarted","Data":"5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465"} Jul 07 07:32:26.442169 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.442124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" event={"ID":"d56d2b89-892e-448c-812b-9c9331390608","Type":"ContainerStarted","Data":"e03a3c59321183cc6c1fa364bc03bbbbde67f98d9f79d401ce19d830af50f9b7"} Jul 07 07:32:26.465341 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.465278 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" podStartSLOduration=1.4652564670000001 podStartE2EDuration="1.465256467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:32:26.46393424 +0000 UTC m=+2019.889147521" watchObservedRunningTime="2026-07-07 07:32:26.465256467 +0000 UTC m=+2019.890469775" Jul 07 07:32:26.863499 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:26.863468 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:27.868472 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:27.868439 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:28.455656 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:28.455622 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:28.456701 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:28.456685 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:34.493344 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:34.493254 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerID="ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0" exitCode=0 Jul 07 07:32:34.493344 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:34.493327 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" event={"ID":"ec6e0f10-7bfd-4d49-82db-217e46a2b375","Type":"ContainerDied","Data":"ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0"} Jul 07 07:32:34.493820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:34.493762 2565 scope.go:117] "RemoveContainer" containerID="ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0" Jul 07 07:32:34.494836 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:34.494802 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:34.494905 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:34.494884 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:34.494945 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:34.494932 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:35.399424 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:35.399389 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:35.500805 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:35.500771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" event={"ID":"ec6e0f10-7bfd-4d49-82db-217e46a2b375","Type":"ContainerStarted","Data":"51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5"} Jul 07 07:32:35.971714 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:35.971674 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:35.971909 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:35.971726 2565 patch_prober.go:28] interesting pod/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 07 07:32:35.971909 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:35.971790 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 07 07:32:36.970398 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:36.970356 2565 patch_prober.go:28] interesting pod/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 07 07:32:36.970909 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:36.970415 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 07 07:32:37.971008 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:37.970968 2565 patch_prober.go:28] interesting pod/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 07 07:32:37.971400 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:37.971028 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 07 07:32:38.970394 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:38.970350 2565 patch_prober.go:28] interesting pod/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 07 07:32:38.970633 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:38.970418 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 07 07:32:39.974573 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:39.974545 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:39.974985 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:39.974839 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:39.975504 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:39.975487 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:41.542027 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:41.541926 2565 generic.go:356] "Generic (PLEG): container finished" podID="d56d2b89-892e-448c-812b-9c9331390608" containerID="5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465" exitCode=0 Jul 07 07:32:41.542027 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:41.542006 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" event={"ID":"d56d2b89-892e-448c-812b-9c9331390608","Type":"ContainerDied","Data":"5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465"} Jul 07 07:32:41.542689 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:41.542666 2565 scope.go:117] "RemoveContainer" containerID="5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465" Jul 07 07:32:41.544014 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:41.543982 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:41.544129 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:41.544067 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:41.544129 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:41.544107 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:41.889626 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:41.889592 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:32:42.551799 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:42.551766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" event={"ID":"d56d2b89-892e-448c-812b-9c9331390608","Type":"ContainerStarted","Data":"2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf"} Jul 07 07:32:42.863951 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:42.863911 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:42.865418 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:42.865388 2565 patch_prober.go:28] interesting pod/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 07 07:32:42.865679 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:42.865651 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 07 07:32:43.456149 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:43.456110 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:43.863843 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:43.863808 2565 patch_prober.go:28] interesting pod/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 07 07:32:43.864240 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:43.863867 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 07 07:32:44.863875 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:44.863831 2565 patch_prober.go:28] interesting pod/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 07 07:32:44.864362 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:44.863901 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 07 07:32:45.864304 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:45.864268 2565 patch_prober.go:28] interesting pod/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 07 07:32:45.864746 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:45.864325 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 07 07:32:46.864357 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:46.864321 2565 patch_prober.go:28] interesting pod/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 07 07:32:46.864792 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:46.864378 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 07 07:32:47.859389 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:47.859338 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99"] Jul 07 07:32:47.859706 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:47.859678 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" containerID="cri-o://51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5" gracePeriod=30 Jul 07 07:32:47.868483 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:47.868463 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:47.869868 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:47.869847 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:32:53.088500 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.088465 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:32:53.128403 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.128338 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:53.246562 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.246526 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-data\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.246750 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.246570 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istiod-ca-cert\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.246750 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.246628 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-token\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.246750 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.246672 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwlwk\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-kube-api-access-xwlwk\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.246750 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.246699 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-certs\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.246958 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.246751 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-podinfo\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.246958 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.246785 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-credential-socket\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.246958 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.246813 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-socket\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.247118 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247055 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:53.247118 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247064 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:32:53.247118 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247068 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:53.247286 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247211 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-envoy\") pod \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\" (UID: \"ec6e0f10-7bfd-4d49-82db-217e46a2b375\") " Jul 07 07:32:53.247345 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247295 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:53.247402 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247350 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:53.247714 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247690 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.247824 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247719 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.247824 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247734 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.247824 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247747 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.247824 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.247762 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.249266 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.249243 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-kube-api-access-xwlwk" (OuterVolumeSpecName: "kube-api-access-xwlwk") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "kube-api-access-xwlwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:32:53.249420 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.249403 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:32:53.249485 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.249402 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:32:53.249565 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.249545 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec6e0f10-7bfd-4d49-82db-217e46a2b375" (UID: "ec6e0f10-7bfd-4d49-82db-217e46a2b375"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:32:53.348776 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.348743 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.348776 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.348773 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwlwk\" (UniqueName: \"kubernetes.io/projected/ec6e0f10-7bfd-4d49-82db-217e46a2b375-kube-api-access-xwlwk\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.348776 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.348783 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.349031 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.348792 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0f10-7bfd-4d49-82db-217e46a2b375-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:32:53.627284 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.627245 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerID="51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5" exitCode=0 Jul 07 07:32:53.627483 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.627307 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" Jul 07 07:32:53.627483 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.627325 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" event={"ID":"ec6e0f10-7bfd-4d49-82db-217e46a2b375","Type":"ContainerDied","Data":"51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5"} Jul 07 07:32:53.627483 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.627407 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99" event={"ID":"ec6e0f10-7bfd-4d49-82db-217e46a2b375","Type":"ContainerDied","Data":"7d87c74e4baafbb7970ca6568a5fddaf04d2a522fbdf4cac62a2d415561c4928"} Jul 07 07:32:53.627483 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.627436 2565 scope.go:117] "RemoveContainer" containerID="51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5" Jul 07 07:32:53.637309 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.637290 2565 scope.go:117] "RemoveContainer" containerID="ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0" Jul 07 07:32:53.646065 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.646046 2565 scope.go:117] "RemoveContainer" containerID="51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5" Jul 07 07:32:53.646362 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:32:53.646342 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5\": container with ID starting with 51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5 not found: ID does not exist" containerID="51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5" Jul 07 07:32:53.646458 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.646374 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5"} err="failed to get container status \"51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5\": rpc error: code = NotFound desc = could not find container \"51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5\": container with ID starting with 51a996381b83131ca46b0da60246f41962552a49d4ab57a3995465274a1b1df5 not found: ID does not exist" Jul 07 07:32:53.646458 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.646400 2565 scope.go:117] "RemoveContainer" containerID="ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0" Jul 07 07:32:53.646723 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:32:53.646698 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0\": container with ID starting with ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0 not found: ID does not exist" containerID="ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0" Jul 07 07:32:53.646797 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.646734 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0"} err="failed to get container status \"ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0\": rpc error: code = NotFound desc = could not find container \"ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0\": container with ID starting with ea46833b64255a4c6cf721fa65a3fd5c6a8c5a5bb3b0f7dee8ce39b9574915a0 not found: ID does not exist" Jul 07 07:32:53.656094 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.656065 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99"] Jul 07 07:32:53.659260 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:53.659232 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-14bf96-openshift-default-757cdc75f5-bnc99"] Jul 07 07:32:55.110632 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.110599 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5"] Jul 07 07:32:55.111047 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.110838 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" containerID="cri-o://2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf" gracePeriod=30 Jul 07 07:32:55.135767 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.135737 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" path="/var/lib/kubelet/pods/ec6e0f10-7bfd-4d49-82db-217e46a2b375/volumes" Jul 07 07:32:55.940628 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.940593 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25"] Jul 07 07:32:55.941016 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.940987 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" Jul 07 07:32:55.941072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.941018 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" Jul 07 07:32:55.941072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.941038 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" Jul 07 07:32:55.941072 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.941044 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" Jul 07 07:32:55.941181 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.941109 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" Jul 07 07:32:55.941181 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.941116 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6e0f10-7bfd-4d49-82db-217e46a2b375" containerName="istio-proxy" Jul 07 07:32:55.945618 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.945577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.947878 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.947854 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-083d4e-openshift-default-dockercfg-k7fgp\"" Jul 07 07:32:55.956944 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.956918 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25"] Jul 07 07:32:55.974098 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974067 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-data\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.974268 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974105 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-token\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.974268 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-socket\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.974268 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-credential-socket\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.974268 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974196 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istiod-ca-cert\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.974268 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpswd\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-kube-api-access-dpswd\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.974439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-podinfo\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.974439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-envoy\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:55.974439 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:55.974327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-certs\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.075494 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-data\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.075740 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-token\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.075740 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075564 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-socket\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.075740 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-credential-socket\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.075740 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istiod-ca-cert\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076002 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpswd\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-kube-api-access-dpswd\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076002 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-podinfo\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076002 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075833 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-envoy\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076002 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075940 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-data\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076002 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.075958 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-socket\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076299 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.076054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-certs\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076299 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.076148 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-credential-socket\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076413 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.076308 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-certs\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.076413 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.076380 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istiod-ca-cert\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.078030 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.078008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-envoy\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.078273 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.078252 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-podinfo\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.085060 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.085034 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-token\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.085236 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.085212 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpswd\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-kube-api-access-dpswd\") pod \"e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.256515 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.256420 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:56.414819 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.414795 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25"] Jul 07 07:32:56.416645 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:32:56.416621 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2c85fb_b61d_49f0_bc70_ae0114c118da.slice/crio-1024fcbaa74157a062a8cd71570d9499e4d91dc8ec9547cdd38e929a7a5edaac WatchSource:0}: Error finding container 1024fcbaa74157a062a8cd71570d9499e4d91dc8ec9547cdd38e929a7a5edaac: Status 404 returned error can't find the container with id 1024fcbaa74157a062a8cd71570d9499e4d91dc8ec9547cdd38e929a7a5edaac Jul 07 07:32:56.418796 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.418763 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:56.418902 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.418824 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:56.418902 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.418858 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:32:56.649654 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.649617 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" event={"ID":"2e2c85fb-b61d-49f0-bc70-ae0114c118da","Type":"ContainerStarted","Data":"62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57"} Jul 07 07:32:56.649829 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.649684 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" event={"ID":"2e2c85fb-b61d-49f0-bc70-ae0114c118da","Type":"ContainerStarted","Data":"1024fcbaa74157a062a8cd71570d9499e4d91dc8ec9547cdd38e929a7a5edaac"} Jul 07 07:32:56.685931 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:56.685881 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" podStartSLOduration=1.6858661480000001 podStartE2EDuration="1.685866148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:32:56.685015582 +0000 UTC m=+2050.110228852" watchObservedRunningTime="2026-07-07 07:32:56.685866148 +0000 UTC m=+2050.111079466" Jul 07 07:32:57.257115 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:57.257075 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:57.262441 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:57.262413 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:57.655837 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:57.655808 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:32:57.656806 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:32:57.656788 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:33:00.369133 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.369106 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:33:00.422405 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422316 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d56d2b89-892e-448c-812b-9c9331390608-istio-podinfo\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.422405 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422363 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d56d2b89-892e-448c-812b-9c9331390608-istiod-ca-cert\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422409 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-envoy\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422447 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-istio-token\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422471 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-socket\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422521 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-credential-socket\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422547 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz8wk\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-kube-api-access-zz8wk\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422613 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-certs\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422649 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-data\") pod \"d56d2b89-892e-448c-812b-9c9331390608\" (UID: \"d56d2b89-892e-448c-812b-9c9331390608\") " Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.422825 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d56d2b89-892e-448c-812b-9c9331390608-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.423023 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.423151 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d56d2b89-892e-448c-812b-9c9331390608-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.423179 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.423146 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:33:00.423381 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.423193 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:33:00.424188 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.423734 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-data" (OuterVolumeSpecName: "istio-data") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:33:00.425242 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.425209 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:33:00.425414 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.425388 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-kube-api-access-zz8wk" (OuterVolumeSpecName: "kube-api-access-zz8wk") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "kube-api-access-zz8wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:33:00.425496 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.425475 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-istio-token" (OuterVolumeSpecName: "istio-token") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:33:00.426347 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.426328 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d56d2b89-892e-448c-812b-9c9331390608-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d56d2b89-892e-448c-812b-9c9331390608" (UID: "d56d2b89-892e-448c-812b-9c9331390608"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:33:00.524269 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.524233 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d56d2b89-892e-448c-812b-9c9331390608-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.524269 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.524267 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.524269 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.524277 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.524516 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.524287 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.524516 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.524295 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.524516 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.524305 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz8wk\" (UniqueName: \"kubernetes.io/projected/d56d2b89-892e-448c-812b-9c9331390608-kube-api-access-zz8wk\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.524516 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.524313 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d56d2b89-892e-448c-812b-9c9331390608-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:33:00.675338 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.675249 2565 generic.go:356] "Generic (PLEG): container finished" podID="d56d2b89-892e-448c-812b-9c9331390608" containerID="2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf" exitCode=0 Jul 07 07:33:00.675338 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.675298 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" Jul 07 07:33:00.675525 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.675330 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" event={"ID":"d56d2b89-892e-448c-812b-9c9331390608","Type":"ContainerDied","Data":"2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf"} Jul 07 07:33:00.675525 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.675388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5" event={"ID":"d56d2b89-892e-448c-812b-9c9331390608","Type":"ContainerDied","Data":"e03a3c59321183cc6c1fa364bc03bbbbde67f98d9f79d401ce19d830af50f9b7"} Jul 07 07:33:00.675525 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.675414 2565 scope.go:117] "RemoveContainer" containerID="2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf" Jul 07 07:33:00.685671 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.685650 2565 scope.go:117] "RemoveContainer" containerID="5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465" Jul 07 07:33:00.694156 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.694139 2565 scope.go:117] "RemoveContainer" containerID="2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf" Jul 07 07:33:00.694399 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:33:00.694379 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf\": container with ID starting with 2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf not found: ID does not exist" containerID="2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf" Jul 07 07:33:00.694448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.694408 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf"} err="failed to get container status \"2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf\": rpc error: code = NotFound desc = could not find container \"2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf\": container with ID starting with 2a4f00a885132acd6eb7a3c2477cc3f7b9c55a0b6515bfd6601f53d752077bcf not found: ID does not exist" Jul 07 07:33:00.694448 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.694427 2565 scope.go:117] "RemoveContainer" containerID="5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465" Jul 07 07:33:00.694723 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:33:00.694704 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465\": container with ID starting with 5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465 not found: ID does not exist" containerID="5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465" Jul 07 07:33:00.694796 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.694728 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465"} err="failed to get container status \"5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465\": rpc error: code = NotFound desc = could not find container \"5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465\": container with ID starting with 5f2a66126fadff273b90916ae28fdf85390983a8c01bcac3a932bf8e1c610465 not found: ID does not exist" Jul 07 07:33:00.699862 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.699839 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5"] Jul 07 07:33:00.704230 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:00.704207 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5b2516-openshift-default-7dff86bb4c-hqgx5"] Jul 07 07:33:01.134613 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:01.134565 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d56d2b89-892e-448c-812b-9c9331390608" path="/var/lib/kubelet/pods/d56d2b89-892e-448c-812b-9c9331390608/volumes" Jul 07 07:33:03.645076 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.645040 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g"] Jul 07 07:33:03.645570 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.645536 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" Jul 07 07:33:03.645570 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.645550 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" Jul 07 07:33:03.645570 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.645562 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" Jul 07 07:33:03.645570 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.645569 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" Jul 07 07:33:03.645851 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.645675 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" Jul 07 07:33:03.645851 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.645687 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d56d2b89-892e-448c-812b-9c9331390608" containerName="istio-proxy" Jul 07 07:33:03.650306 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.650283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.652732 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.652709 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1082ad-openshift-default-dockercfg-p7spk\"" Jul 07 07:33:03.662263 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.662236 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g"] Jul 07 07:33:03.751709 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.751667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnzk7\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-kube-api-access-lnzk7\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.752027 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.751997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-token\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.752027 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.752039 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-data\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.752228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.752072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-envoy\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.752228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.752102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-socket\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.752228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.752161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istiod-ca-cert\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.752228 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.752203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-podinfo\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.752452 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.752261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-certs\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.752452 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.752337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-credential-socket\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.853527 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.853494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-credential-socket\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.853727 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.853552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnzk7\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-kube-api-access-lnzk7\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.853727 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.853617 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-token\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.853727 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.853640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-data\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.853727 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.853668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-envoy\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.853727 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.853714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-socket\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.854041 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.853864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istiod-ca-cert\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.854041 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.853955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-podinfo\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.854212 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.854032 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-certs\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.854212 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.854053 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-data\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.854318 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.854063 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-credential-socket\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.854715 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.854642 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istiod-ca-cert\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.854864 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.854779 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-socket\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.854864 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.854836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-certs\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.856253 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.856226 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-envoy\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.856902 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.856875 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-podinfo\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.864196 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.864173 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-token\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.864840 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.864823 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnzk7\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-kube-api-access-lnzk7\") pod \"e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:03.961498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:03.961418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:04.106382 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.106345 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g"] Jul 07 07:33:04.107714 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:33:04.107688 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c7c3f7_ca77_445b_a510_cc7d7e908e15.slice/crio-93e6a6c74165f5d18f06efa8dc0f554acd21ccf9a668faddc7fbbf88c766a05b WatchSource:0}: Error finding container 93e6a6c74165f5d18f06efa8dc0f554acd21ccf9a668faddc7fbbf88c766a05b: Status 404 returned error can't find the container with id 93e6a6c74165f5d18f06efa8dc0f554acd21ccf9a668faddc7fbbf88c766a05b Jul 07 07:33:04.109976 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.109946 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:04.110070 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.110014 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:04.110070 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.110045 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:04.389621 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.389551 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:33:04.701970 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.701885 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" event={"ID":"30c7c3f7-ca77-445b-a510-cc7d7e908e15","Type":"ContainerStarted","Data":"cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988"} Jul 07 07:33:04.701970 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.701939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" event={"ID":"30c7c3f7-ca77-445b-a510-cc7d7e908e15","Type":"ContainerStarted","Data":"93e6a6c74165f5d18f06efa8dc0f554acd21ccf9a668faddc7fbbf88c766a05b"} Jul 07 07:33:04.729333 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.729284 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" podStartSLOduration=1.729268968 podStartE2EDuration="1.729268968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:33:04.725956882 +0000 UTC m=+2058.151170152" watchObservedRunningTime="2026-07-07 07:33:04.729268968 +0000 UTC m=+2058.154482236" Jul 07 07:33:04.962391 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:04.962307 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:05.966503 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:05.966470 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:06.714156 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:06.714123 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:06.715175 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:06.715157 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:12.696160 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:12.695053 2565 patch_prober.go:28] interesting pod/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": read tcp 10.133.0.2:57016->10.133.0.64:15021: read: connection reset by peer" start-of-body= Jul 07 07:33:12.696160 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:12.695126 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": read tcp 10.133.0.2:57016->10.133.0.64:15021: read: connection reset by peer" Jul 07 07:33:12.759314 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:12.759281 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerID="62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57" exitCode=0 Jul 07 07:33:12.759481 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:12.759329 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" event={"ID":"2e2c85fb-b61d-49f0-bc70-ae0114c118da","Type":"ContainerDied","Data":"62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57"} Jul 07 07:33:12.759719 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:12.759705 2565 scope.go:117] "RemoveContainer" containerID="62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57" Jul 07 07:33:12.760722 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:12.760695 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:12.760782 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:12.760766 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:12.760828 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:12.760797 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:13.771596 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:13.771535 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" event={"ID":"2e2c85fb-b61d-49f0-bc70-ae0114c118da","Type":"ContainerStarted","Data":"e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5"} Jul 07 07:33:14.257427 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:14.257380 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:33:14.257642 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:14.257527 2565 patch_prober.go:28] interesting pod/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Jul 07 07:33:14.257642 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:14.257577 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Jul 07 07:33:15.257314 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:15.257263 2565 patch_prober.go:28] interesting pod/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Jul 07 07:33:15.257863 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:15.257338 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Jul 07 07:33:16.257033 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:16.256992 2565 patch_prober.go:28] interesting pod/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Jul 07 07:33:16.257197 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:16.257059 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Jul 07 07:33:17.257227 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:17.257188 2565 patch_prober.go:28] interesting pod/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Jul 07 07:33:17.257725 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:17.257254 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Jul 07 07:33:18.260221 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:18.260187 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:33:18.260643 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:18.260521 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:33:18.261258 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:18.261240 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:33:19.682252 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:19.682214 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:33:19.814194 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:19.814162 2565 generic.go:356] "Generic (PLEG): container finished" podID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerID="cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988" exitCode=0 Jul 07 07:33:19.814361 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:19.814228 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" event={"ID":"30c7c3f7-ca77-445b-a510-cc7d7e908e15","Type":"ContainerDied","Data":"cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988"} Jul 07 07:33:19.814674 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:19.814661 2565 scope.go:117] "RemoveContainer" containerID="cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988" Jul 07 07:33:19.815745 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:19.815723 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:19.815821 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:19.815787 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:19.815858 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:19.815821 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 07:33:20.825498 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:20.825459 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" event={"ID":"30c7c3f7-ca77-445b-a510-cc7d7e908e15","Type":"ContainerStarted","Data":"d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927"} Jul 07 07:33:20.961750 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:20.961713 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:20.962780 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:20.962758 2565 patch_prober.go:28] interesting pod/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 07 07:33:20.962895 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:20.962802 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 07 07:33:21.714644 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:21.714604 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:21.961902 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:21.961863 2565 patch_prober.go:28] interesting pod/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 07 07:33:21.962284 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:21.961930 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 07 07:33:22.961821 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:22.961790 2565 patch_prober.go:28] interesting pod/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 07 07:33:22.961994 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:22.961840 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 07 07:33:23.962143 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:23.962103 2565 patch_prober.go:28] interesting pod/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 07 07:33:23.962556 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:23.962161 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 07 07:33:24.965849 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:24.965814 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:24.966822 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:24.966801 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:33:29.981694 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:29.981651 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:33:46.884552 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:33:46.884506 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:34:02.087110 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:34:02.087075 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:34:18.693728 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:34:18.693688 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:34:33.484227 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:34:33.484187 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:34:49.286620 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:34:49.286512 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:35:04.694429 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:35:04.694393 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:35:21.605994 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:35:21.605956 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:35:39.189730 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:35:39.189696 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:35:53.486327 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:35:53.486292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:36:04.080107 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:36:04.080065 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:36:20.290332 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:36:20.290248 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:36:34.285178 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:36:34.285142 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:36:47.927411 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:36:47.927376 2565 scope.go:117] "RemoveContainer" containerID="aa1ebdeba57093f7e2e6006d1658c5bb2acef79f7572b50535db20c8b21fddcf" Jul 07 07:36:47.936806 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:36:47.936783 2565 scope.go:117] "RemoveContainer" containerID="17a99783846736fcea9c3013cb98fa95823ed16b0375278103d3e3ace1642735" Jul 07 07:36:51.892627 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:36:51.892570 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:37:10.586054 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:37:10.586013 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:37:39.500182 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:37:39.500097 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:38:04.018367 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:38:04.018322 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:38:17.104942 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:38:17.104904 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:38:30.008419 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:38:30.008382 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:39:09.087856 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:09.087821 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25"] Jul 07 07:39:09.088537 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:09.088066 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" containerID="cri-o://e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5" gracePeriod=30 Jul 07 07:39:13.333818 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:13.333781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-jlwlb"] Jul 07 07:39:14.357364 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.357302 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:39:14.504679 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504637 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpswd\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-kube-api-access-dpswd\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.504883 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504696 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istiod-ca-cert\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.504883 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504735 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-data\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.504883 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504780 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-token\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.504883 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504811 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-envoy\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.504883 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504849 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-credential-socket\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.504883 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504879 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-podinfo\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.505232 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504919 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-socket\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.505232 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.504939 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-certs\") pod \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\" (UID: \"2e2c85fb-b61d-49f0-bc70-ae0114c118da\") " Jul 07 07:39:14.505232 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.505128 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:14.505232 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.505173 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:39:14.505476 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.505360 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:14.505476 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.505395 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.505476 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.505417 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.505668 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.505533 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:14.505726 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.505697 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:14.507079 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.507055 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:14.507196 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.507107 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:39:14.507196 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.507127 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-kube-api-access-dpswd" (OuterVolumeSpecName: "kube-api-access-dpswd") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "kube-api-access-dpswd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:39:14.507196 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.507180 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e2c85fb-b61d-49f0-bc70-ae0114c118da" (UID: "2e2c85fb-b61d-49f0-bc70-ae0114c118da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:39:14.606425 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.606379 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.606425 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.606415 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.606425 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.606424 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.606425 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.606431 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e2c85fb-b61d-49f0-bc70-ae0114c118da-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.606760 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.606440 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.606760 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.606449 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e2c85fb-b61d-49f0-bc70-ae0114c118da-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.606760 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.606458 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpswd\" (UniqueName: \"kubernetes.io/projected/2e2c85fb-b61d-49f0-bc70-ae0114c118da-kube-api-access-dpswd\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:14.904289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.904258 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerID="e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5" exitCode=0 Jul 07 07:39:14.904474 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.904309 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" Jul 07 07:39:14.904474 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.904357 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" event={"ID":"2e2c85fb-b61d-49f0-bc70-ae0114c118da","Type":"ContainerDied","Data":"e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5"} Jul 07 07:39:14.904474 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.904464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25" event={"ID":"2e2c85fb-b61d-49f0-bc70-ae0114c118da","Type":"ContainerDied","Data":"1024fcbaa74157a062a8cd71570d9499e4d91dc8ec9547cdd38e929a7a5edaac"} Jul 07 07:39:14.904578 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.904501 2565 scope.go:117] "RemoveContainer" containerID="e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5" Jul 07 07:39:14.914904 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.914885 2565 scope.go:117] "RemoveContainer" containerID="62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57" Jul 07 07:39:14.924882 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.924860 2565 scope.go:117] "RemoveContainer" containerID="e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5" Jul 07 07:39:14.925172 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:39:14.925149 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5\": container with ID starting with e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5 not found: ID does not exist" containerID="e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5" Jul 07 07:39:14.925272 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.925181 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5"} err="failed to get container status \"e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5\": rpc error: code = NotFound desc = could not find container \"e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5\": container with ID starting with e3c221576f6b13820c2f57abc2a85b37c37145cb3b7251e6382ef2aa34422da5 not found: ID does not exist" Jul 07 07:39:14.925272 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.925199 2565 scope.go:117] "RemoveContainer" containerID="62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57" Jul 07 07:39:14.925440 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:39:14.925422 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57\": container with ID starting with 62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57 not found: ID does not exist" containerID="62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57" Jul 07 07:39:14.925496 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.925445 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57"} err="failed to get container status \"62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57\": rpc error: code = NotFound desc = could not find container \"62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57\": container with ID starting with 62bbba7eec44bb26fc0d2a44e0a9fb062e3e4559f9eaa5ef5f5a6582752ece57 not found: ID does not exist" Jul 07 07:39:14.950673 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.950638 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25"] Jul 07 07:39:14.970857 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:14.970825 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-083d4e-openshift-default-6cc59cfb7f-mgl25"] Jul 07 07:39:15.136021 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:15.135979 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" path="/var/lib/kubelet/pods/2e2c85fb-b61d-49f0-bc70-ae0114c118da/volumes" Jul 07 07:39:18.657179 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:18.657145 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g"] Jul 07 07:39:18.657651 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:18.657366 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" containerID="cri-o://d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927" gracePeriod=30 Jul 07 07:39:23.900406 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.900375 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:39:23.960351 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.960262 2565 generic.go:356] "Generic (PLEG): container finished" podID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerID="d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927" exitCode=0 Jul 07 07:39:23.960351 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.960301 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" event={"ID":"30c7c3f7-ca77-445b-a510-cc7d7e908e15","Type":"ContainerDied","Data":"d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927"} Jul 07 07:39:23.960578 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.960369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" event={"ID":"30c7c3f7-ca77-445b-a510-cc7d7e908e15","Type":"ContainerDied","Data":"93e6a6c74165f5d18f06efa8dc0f554acd21ccf9a668faddc7fbbf88c766a05b"} Jul 07 07:39:23.960578 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.960314 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g" Jul 07 07:39:23.960578 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.960399 2565 scope.go:117] "RemoveContainer" containerID="d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927" Jul 07 07:39:23.969504 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.969478 2565 scope.go:117] "RemoveContainer" containerID="cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988" Jul 07 07:39:23.978625 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.978608 2565 scope.go:117] "RemoveContainer" containerID="d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927" Jul 07 07:39:23.978938 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:39:23.978916 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927\": container with ID starting with d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927 not found: ID does not exist" containerID="d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927" Jul 07 07:39:23.979024 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.978947 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927"} err="failed to get container status \"d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927\": rpc error: code = NotFound desc = could not find container \"d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927\": container with ID starting with d246f55145ea90cef688bff80c6091a30455f2a709420a96c1654c9e479e0927 not found: ID does not exist" Jul 07 07:39:23.979024 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.978964 2565 scope.go:117] "RemoveContainer" containerID="cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988" Jul 07 07:39:23.979200 ip-10-0-138-175 kubenswrapper[2565]: E0707 07:39:23.979184 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988\": container with ID starting with cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988 not found: ID does not exist" containerID="cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988" Jul 07 07:39:23.979243 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.979203 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988"} err="failed to get container status \"cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988\": rpc error: code = NotFound desc = could not find container \"cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988\": container with ID starting with cd5285fc18cf2f69fd44661bd5ab9d8407ba3ead33c2ba7c3f0eb2b5f8cea988 not found: ID does not exist" Jul 07 07:39:23.993771 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.993740 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-token\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.993938 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.993804 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-certs\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.993938 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.993828 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnzk7\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-kube-api-access-lnzk7\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.994060 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.993935 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-envoy\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.994060 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.993982 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-podinfo\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.994060 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994043 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-socket\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.994226 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994074 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istiod-ca-cert\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.994226 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994129 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-credential-socket\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.994226 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994164 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-data\") pod \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\" (UID: \"30c7c3f7-ca77-445b-a510-cc7d7e908e15\") " Jul 07 07:39:23.994511 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994159 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:23.994511 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994359 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:23.994511 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994368 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:23.994511 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994501 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 07:39:23.994766 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994634 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-certs\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:23.994766 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994654 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-workload-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:23.994766 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994667 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istiod-ca-cert\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:23.994766 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.994679 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-credential-socket\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:23.995400 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.995374 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-data" (OuterVolumeSpecName: "istio-data") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:23.996164 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.996139 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 07:39:23.996444 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.996424 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 07:39:23.996514 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.996457 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-token" (OuterVolumeSpecName: "istio-token") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:39:23.996514 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:23.996488 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-kube-api-access-lnzk7" (OuterVolumeSpecName: "kube-api-access-lnzk7") pod "30c7c3f7-ca77-445b-a510-cc7d7e908e15" (UID: "30c7c3f7-ca77-445b-a510-cc7d7e908e15"). InnerVolumeSpecName "kube-api-access-lnzk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 07:39:24.096239 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:24.096200 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-token\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:24.096239 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:24.096235 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnzk7\" (UniqueName: \"kubernetes.io/projected/30c7c3f7-ca77-445b-a510-cc7d7e908e15-kube-api-access-lnzk7\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:24.096239 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:24.096245 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-envoy\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:24.096239 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:24.096253 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-podinfo\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:24.096527 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:24.096261 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30c7c3f7-ca77-445b-a510-cc7d7e908e15-istio-data\") on node \"ip-10-0-138-175.ec2.internal\" DevicePath \"\"" Jul 07 07:39:24.290296 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:24.290260 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g"] Jul 07 07:39:24.297809 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:24.297780 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1082ad-openshift-default-75df6bbd55-d764g"] Jul 07 07:39:25.115539 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:25.115507 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723475-sr874_47c41d51-5f23-436c-bdc4-fae1a9057093/cleanup/0.log" Jul 07 07:39:25.133972 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:25.133935 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" path="/var/lib/kubelet/pods/30c7c3f7-ca77-445b-a510-cc7d7e908e15/volumes" Jul 07 07:39:25.785272 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:25.785237 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbf9cc589-cj7hb_9633bb19-6f0a-414a-abfe-31ac61e45e20/copy-manifests/0.log" Jul 07 07:39:25.795936 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:25.795911 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbf9cc589-cj7hb_9633bb19-6f0a-414a-abfe-31ac61e45e20/manager/0.log" Jul 07 07:39:27.091045 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.091009 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm_7c9434e0-97b8-49a2-a87c-89bd5ef032ae/util/0.log" Jul 07 07:39:27.111222 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.111196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm_7c9434e0-97b8-49a2-a87c-89bd5ef032ae/pull/0.log" Jul 07 07:39:27.131746 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.131716 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm_7c9434e0-97b8-49a2-a87c-89bd5ef032ae/extract/0.log" Jul 07 07:39:27.262255 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.262226 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r_e11f6777-0521-46ea-aac2-47445ec99495/util/0.log" Jul 07 07:39:27.284893 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.284866 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r_e11f6777-0521-46ea-aac2-47445ec99495/pull/0.log" Jul 07 07:39:27.304606 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.304553 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r_e11f6777-0521-46ea-aac2-47445ec99495/extract/0.log" Jul 07 07:39:27.424718 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.424634 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7_fca513d1-6510-49d1-b523-740366056700/util/0.log" Jul 07 07:39:27.437680 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.437650 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7_fca513d1-6510-49d1-b523-740366056700/pull/0.log" Jul 07 07:39:27.448074 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.448041 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7_fca513d1-6510-49d1-b523-740366056700/extract/0.log" Jul 07 07:39:27.592683 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.592653 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76_f78957d9-8c58-4f95-8bfd-5a8013ce7381/util/0.log" Jul 07 07:39:27.608401 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.608373 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76_f78957d9-8c58-4f95-8bfd-5a8013ce7381/pull/0.log" Jul 07 07:39:27.621338 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:27.621317 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76_f78957d9-8c58-4f95-8bfd-5a8013ce7381/extract/0.log" Jul 07 07:39:28.021782 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:28.021750 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s9qdr_ea79a5d9-92a0-44d6-a1ac-1e5251f50df5/manager/0.log" Jul 07 07:39:28.136896 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:28.136870 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-t8sj4_42f35957-f947-4b61-8155-55fa83de2946/kuadrant-console-plugin/0.log" Jul 07 07:39:28.258198 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:28.258167 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g5hck_5ff1d1d5-729c-4efb-8562-670a48268303/registry-server/0.log" Jul 07 07:39:28.397662 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:28.397631 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2268q_1e3cd4b1-3c77-4da9-9155-aa39a811a781/manager/0.log" Jul 07 07:39:28.511904 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:28.511875 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jlwlb_e8568b92-27ed-46bb-acf0-1e142a142bd4/limitador/0.log" Jul 07 07:39:28.996656 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:28.996627 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fdtqw_c2de6520-4a95-4908-87dd-9a9b8b3d22f2/istio-proxy/0.log" Jul 07 07:39:29.482063 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:29.482027 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h26rd_3d741e70-65e3-4375-92fb-51f48cb6e371/istio-proxy/1.log" Jul 07 07:39:29.875001 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:29.874972 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dcff594f7-w7xr6_7a1f9c3e-403d-4bc1-89a3-3d48e64530dd/router/0.log" Jul 07 07:39:35.100052 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100009 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zwr9g/must-gather-bw5k6"] Jul 07 07:39:35.100601 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100564 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" Jul 07 07:39:35.100601 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100601 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" Jul 07 07:39:35.100758 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100619 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" Jul 07 07:39:35.100758 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100628 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" Jul 07 07:39:35.100758 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100657 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" Jul 07 07:39:35.100758 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100666 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" Jul 07 07:39:35.100968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100781 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" Jul 07 07:39:35.100968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100797 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" Jul 07 07:39:35.100968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100806 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" Jul 07 07:39:35.100968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100816 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2c85fb-b61d-49f0-bc70-ae0114c118da" containerName="istio-proxy" Jul 07 07:39:35.100968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100923 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" Jul 07 07:39:35.100968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.100932 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c7c3f7-ca77-445b-a510-cc7d7e908e15" containerName="istio-proxy" Jul 07 07:39:35.105456 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.105434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zwr9g/must-gather-bw5k6" Jul 07 07:39:35.112389 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.112085 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zwr9g\"/\"openshift-service-ca.crt\"" Jul 07 07:39:35.112389 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.112105 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zwr9g\"/\"default-dockercfg-r2qnp\"" Jul 07 07:39:35.114973 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.114956 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zwr9g\"/\"kube-root-ca.crt\"" Jul 07 07:39:35.124450 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.124428 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zwr9g/must-gather-bw5k6"] Jul 07 07:39:35.199981 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.199942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dab1ad69-933b-4f8b-a58a-4aec19a1dba2-must-gather-output\") pod \"must-gather-bw5k6\" (UID: \"dab1ad69-933b-4f8b-a58a-4aec19a1dba2\") " pod="openshift-must-gather-zwr9g/must-gather-bw5k6" Jul 07 07:39:35.200165 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.200073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk6b8\" (UniqueName: \"kubernetes.io/projected/dab1ad69-933b-4f8b-a58a-4aec19a1dba2-kube-api-access-fk6b8\") pod \"must-gather-bw5k6\" (UID: \"dab1ad69-933b-4f8b-a58a-4aec19a1dba2\") " pod="openshift-must-gather-zwr9g/must-gather-bw5k6" Jul 07 07:39:35.300523 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.300484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dab1ad69-933b-4f8b-a58a-4aec19a1dba2-must-gather-output\") pod \"must-gather-bw5k6\" (UID: \"dab1ad69-933b-4f8b-a58a-4aec19a1dba2\") " pod="openshift-must-gather-zwr9g/must-gather-bw5k6" Jul 07 07:39:35.300723 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.300616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk6b8\" (UniqueName: \"kubernetes.io/projected/dab1ad69-933b-4f8b-a58a-4aec19a1dba2-kube-api-access-fk6b8\") pod \"must-gather-bw5k6\" (UID: \"dab1ad69-933b-4f8b-a58a-4aec19a1dba2\") " pod="openshift-must-gather-zwr9g/must-gather-bw5k6" Jul 07 07:39:35.300873 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.300852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dab1ad69-933b-4f8b-a58a-4aec19a1dba2-must-gather-output\") pod \"must-gather-bw5k6\" (UID: \"dab1ad69-933b-4f8b-a58a-4aec19a1dba2\") " pod="openshift-must-gather-zwr9g/must-gather-bw5k6" Jul 07 07:39:35.323623 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.323577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk6b8\" (UniqueName: \"kubernetes.io/projected/dab1ad69-933b-4f8b-a58a-4aec19a1dba2-kube-api-access-fk6b8\") pod \"must-gather-bw5k6\" (UID: \"dab1ad69-933b-4f8b-a58a-4aec19a1dba2\") " pod="openshift-must-gather-zwr9g/must-gather-bw5k6" Jul 07 07:39:35.414777 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.414687 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zwr9g/must-gather-bw5k6" Jul 07 07:39:35.590850 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.590811 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zwr9g/must-gather-bw5k6"] Jul 07 07:39:35.593853 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:39:35.593827 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddab1ad69_933b_4f8b_a58a_4aec19a1dba2.slice/crio-e075c65e77c43c6332e57e34d7bf3e579fbca4c2d6e3af58057514258ae583b4 WatchSource:0}: Error finding container e075c65e77c43c6332e57e34d7bf3e579fbca4c2d6e3af58057514258ae583b4: Status 404 returned error can't find the container with id e075c65e77c43c6332e57e34d7bf3e579fbca4c2d6e3af58057514258ae583b4 Jul 07 07:39:35.595708 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:35.595690 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 07:39:36.027721 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:36.027684 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zwr9g/must-gather-bw5k6" event={"ID":"dab1ad69-933b-4f8b-a58a-4aec19a1dba2","Type":"ContainerStarted","Data":"e075c65e77c43c6332e57e34d7bf3e579fbca4c2d6e3af58057514258ae583b4"} Jul 07 07:39:37.034660 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:37.034624 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zwr9g/must-gather-bw5k6" event={"ID":"dab1ad69-933b-4f8b-a58a-4aec19a1dba2","Type":"ContainerStarted","Data":"128edb7921bc2e63ed9c43132a0dca46abc625593fc4761bf3a17789a4a1ca77"} Jul 07 07:39:37.035134 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:37.034670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zwr9g/must-gather-bw5k6" event={"ID":"dab1ad69-933b-4f8b-a58a-4aec19a1dba2","Type":"ContainerStarted","Data":"6886c5995e4df30ef624f24a13822f5bcef69a2e8cd21146d44371b5e93639fb"} Jul 07 07:39:37.085929 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:37.085875 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zwr9g/must-gather-bw5k6" podStartSLOduration=1.14898259 podStartE2EDuration="2.085857768s" totalImagesPullingTime="936.875178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 07:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:39:37.085139473 +0000 UTC m=+2450.510352752" watchObservedRunningTime="2026-07-07 07:39:37.085857768 +0000 UTC m=+2450.511071036" Jul 07 07:39:39.090203 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:39.090161 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bfh2d_8619f98f-805f-4ce7-83e8-8b1de3672e14/global-pull-secret-syncer/0.log" Jul 07 07:39:39.362276 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:39.362198 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-stzn4_dbe3ed12-65a1-4a01-a51f-37ca984cd135/konnectivity-agent/0.log" Jul 07 07:39:39.576164 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:39.576128 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-175.ec2.internal_d196a27e053baa6bcb43fbca1f374dc8/haproxy/0.log" Jul 07 07:39:43.463987 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.463954 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm_7c9434e0-97b8-49a2-a87c-89bd5ef032ae/extract/0.log" Jul 07 07:39:43.510726 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.510692 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm_7c9434e0-97b8-49a2-a87c-89bd5ef032ae/util/0.log" Jul 07 07:39:43.553700 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.553621 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598srhm_7c9434e0-97b8-49a2-a87c-89bd5ef032ae/pull/0.log" Jul 07 07:39:43.596913 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.596876 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r_e11f6777-0521-46ea-aac2-47445ec99495/extract/0.log" Jul 07 07:39:43.628742 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.628707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r_e11f6777-0521-46ea-aac2-47445ec99495/util/0.log" Jul 07 07:39:43.666030 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.665995 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vst2r_e11f6777-0521-46ea-aac2-47445ec99495/pull/0.log" Jul 07 07:39:43.705599 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.705559 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7_fca513d1-6510-49d1-b523-740366056700/extract/0.log" Jul 07 07:39:43.745853 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.745754 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7_fca513d1-6510-49d1-b523-740366056700/util/0.log" Jul 07 07:39:43.782130 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.782105 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fhtp7_fca513d1-6510-49d1-b523-740366056700/pull/0.log" Jul 07 07:39:43.822022 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.821991 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76_f78957d9-8c58-4f95-8bfd-5a8013ce7381/extract/0.log" Jul 07 07:39:43.854099 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.854072 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76_f78957d9-8c58-4f95-8bfd-5a8013ce7381/util/0.log" Jul 07 07:39:43.884614 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:43.884573 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18cl76_f78957d9-8c58-4f95-8bfd-5a8013ce7381/pull/0.log" Jul 07 07:39:44.408084 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:44.408020 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s9qdr_ea79a5d9-92a0-44d6-a1ac-1e5251f50df5/manager/0.log" Jul 07 07:39:44.458793 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:44.458768 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-t8sj4_42f35957-f947-4b61-8155-55fa83de2946/kuadrant-console-plugin/0.log" Jul 07 07:39:44.516425 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:44.516392 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g5hck_5ff1d1d5-729c-4efb-8562-670a48268303/registry-server/0.log" Jul 07 07:39:44.686511 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:44.686423 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2268q_1e3cd4b1-3c77-4da9-9155-aa39a811a781/manager/0.log" Jul 07 07:39:44.738941 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:44.738913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-jlwlb_e8568b92-27ed-46bb-acf0-1e142a142bd4/limitador/0.log" Jul 07 07:39:46.589296 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.589254 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d/alertmanager/0.log" Jul 07 07:39:46.621150 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.621120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d/config-reloader/0.log" Jul 07 07:39:46.649569 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.649544 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d/kube-rbac-proxy-web/0.log" Jul 07 07:39:46.683434 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.683411 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d/kube-rbac-proxy/0.log" Jul 07 07:39:46.723572 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.723543 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d/kube-rbac-proxy-metric/0.log" Jul 07 07:39:46.763143 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.763111 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d/prom-label-proxy/0.log" Jul 07 07:39:46.806898 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.806861 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2a21ae60-9a03-4ed7-bc92-a54ef1b4d61d/init-config-reloader/0.log" Jul 07 07:39:46.903440 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.903346 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-d778w_84a31cbf-7a28-4297-9b65-02953544e254/kube-state-metrics/0.log" Jul 07 07:39:46.949726 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.949699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-d778w_84a31cbf-7a28-4297-9b65-02953544e254/kube-rbac-proxy-main/0.log" Jul 07 07:39:46.984092 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:46.984058 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-d778w_84a31cbf-7a28-4297-9b65-02953544e254/kube-rbac-proxy-self/0.log" Jul 07 07:39:47.033545 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:47.033512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64b64b8bb5-cblmj_b1afd686-5b3f-4d1d-a48a-68521a3f2ce8/metrics-server/0.log" Jul 07 07:39:47.100868 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:47.100841 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-mpns7_cec97655-5c6a-4fcd-a1ad-c273cc0b672e/monitoring-plugin/0.log" Jul 07 07:39:47.334133 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:47.334095 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckv7d_0c391394-aa02-488e-9267-410b75525ade/node-exporter/0.log" Jul 07 07:39:47.375289 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:47.375257 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckv7d_0c391394-aa02-488e-9267-410b75525ade/kube-rbac-proxy/0.log" Jul 07 07:39:47.446400 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:47.446367 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ckv7d_0c391394-aa02-488e-9267-410b75525ade/init-textfile/0.log" Jul 07 07:39:47.593503 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:47.593387 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-w7tkk_c02c2fa8-b68a-440e-a7dd-ec02eea2a906/kube-rbac-proxy-main/0.log" Jul 07 07:39:47.623702 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:47.623669 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-w7tkk_c02c2fa8-b68a-440e-a7dd-ec02eea2a906/kube-rbac-proxy-self/0.log" Jul 07 07:39:47.654706 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:47.654665 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-w7tkk_c02c2fa8-b68a-440e-a7dd-ec02eea2a906/openshift-state-metrics/0.log" Jul 07 07:39:48.015363 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.015261 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-j9sjh_04b74bba-22de-4113-aa65-4e2e3d6983ea/prometheus-operator-admission-webhook/0.log" Jul 07 07:39:48.060233 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.060200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c959b9866-qwd9x_771cb096-2943-41a5-806d-1688c35fa071/telemeter-client/0.log" Jul 07 07:39:48.091458 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.091430 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c959b9866-qwd9x_771cb096-2943-41a5-806d-1688c35fa071/reload/0.log" Jul 07 07:39:48.118910 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.118879 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c959b9866-qwd9x_771cb096-2943-41a5-806d-1688c35fa071/kube-rbac-proxy/0.log" Jul 07 07:39:48.158557 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.158523 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9447d957d-rht4c_fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5/thanos-query/0.log" Jul 07 07:39:48.188247 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.188205 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9447d957d-rht4c_fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5/kube-rbac-proxy-web/0.log" Jul 07 07:39:48.215950 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.215921 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9447d957d-rht4c_fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5/kube-rbac-proxy/0.log" Jul 07 07:39:48.246109 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.246018 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9447d957d-rht4c_fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5/prom-label-proxy/0.log" Jul 07 07:39:48.280611 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.280564 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9447d957d-rht4c_fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5/kube-rbac-proxy-rules/0.log" Jul 07 07:39:48.312878 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.312850 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9447d957d-rht4c_fb1a9ef3-3d5c-45f2-8d6a-0126c6ceb9c5/kube-rbac-proxy-metrics/0.log" Jul 07 07:39:48.500968 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.500873 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5"] Jul 07 07:39:48.509605 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.509564 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.518570 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.518525 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5"] Jul 07 07:39:48.658672 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.658634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbzhw\" (UniqueName: \"kubernetes.io/projected/9648fad9-4ed8-45d2-9481-1d091ef0fb95-kube-api-access-fbzhw\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.659144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.658693 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-lib-modules\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.659144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.658751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-sys\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.659144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.658795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-podres\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.659144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.658854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-proc\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760151 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760056 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-proc\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760151 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbzhw\" (UniqueName: \"kubernetes.io/projected/9648fad9-4ed8-45d2-9481-1d091ef0fb95-kube-api-access-fbzhw\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760151 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-lib-modules\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760373 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-sys\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760373 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-podres\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760373 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760221 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-proc\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760373 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760320 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-sys\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760373 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760334 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-lib-modules\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.760541 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.760397 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9648fad9-4ed8-45d2-9481-1d091ef0fb95-podres\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.770869 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.770843 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbzhw\" (UniqueName: \"kubernetes.io/projected/9648fad9-4ed8-45d2-9481-1d091ef0fb95-kube-api-access-fbzhw\") pod \"perf-node-gather-daemonset-9sjl5\" (UID: \"9648fad9-4ed8-45d2-9481-1d091ef0fb95\") " pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:48.823649 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:48.823608 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:49.026374 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:49.023986 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5"] Jul 07 07:39:49.028190 ip-10-0-138-175 kubenswrapper[2565]: W0707 07:39:49.028166 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9648fad9_4ed8_45d2_9481_1d091ef0fb95.slice/crio-0c5cec7f36ab7283d3f819692e1cf9c9b3beffd746a7b3efccb9df33e35c2742 WatchSource:0}: Error finding container 0c5cec7f36ab7283d3f819692e1cf9c9b3beffd746a7b3efccb9df33e35c2742: Status 404 returned error can't find the container with id 0c5cec7f36ab7283d3f819692e1cf9c9b3beffd746a7b3efccb9df33e35c2742 Jul 07 07:39:49.145184 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:49.145149 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" event={"ID":"9648fad9-4ed8-45d2-9481-1d091ef0fb95","Type":"ContainerStarted","Data":"0c5cec7f36ab7283d3f819692e1cf9c9b3beffd746a7b3efccb9df33e35c2742"} Jul 07 07:39:50.154874 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:50.154842 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" event={"ID":"9648fad9-4ed8-45d2-9481-1d091ef0fb95","Type":"ContainerStarted","Data":"de953cac48a45bf8b74a2a1441aadc26e8f24ea504debc6e1c75f1f9068b8d6d"} Jul 07 07:39:50.155308 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:50.154957 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:50.182914 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:50.182862 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" podStartSLOduration=2.182843925 podStartE2EDuration="2.182843925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 07:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 07:39:50.182216943 +0000 UTC m=+2463.607430213" watchObservedRunningTime="2026-07-07 07:39:50.182843925 +0000 UTC m=+2463.608057193" Jul 07 07:39:50.791252 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:50.791213 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-v8lgt_2a6c1d23-522c-40e6-9fcb-95fc8afc8255/download-server/0.log" Jul 07 07:39:51.510922 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:51.510886 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-sbs8w_627aff8d-0eb6-4cf5-af28-4bae58ca209b/volume-data-source-validator/0.log" Jul 07 07:39:52.798112 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:52.798062 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-drl6g_ff0cbbb7-f327-4c1e-a923-501328a5803e/dns/0.log" Jul 07 07:39:52.831540 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:52.831510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-drl6g_ff0cbbb7-f327-4c1e-a923-501328a5803e/kube-rbac-proxy/0.log" Jul 07 07:39:53.050144 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:53.050057 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8hjwm_89aba0d1-d5cc-41f2-99ee-87ccf30b8e2e/dns-node-resolver/0.log" Jul 07 07:39:53.733152 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:53.733117 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66d564749-ln86g_fac45567-ed8f-48da-b083-d9d07f8085aa/registry/0.log" Jul 07 07:39:53.832676 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:53.832629 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf7db_b9072c5b-67b1-41cc-80c9-503b7096c72d/node-ca/0.log" Jul 07 07:39:54.949019 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:54.948984 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fdtqw_c2de6520-4a95-4908-87dd-9a9b8b3d22f2/istio-proxy/0.log" Jul 07 07:39:55.181574 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:55.181536 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h26rd_3d741e70-65e3-4375-92fb-51f48cb6e371/istio-proxy/0.log" Jul 07 07:39:55.237535 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:55.237447 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h26rd_3d741e70-65e3-4375-92fb-51f48cb6e371/istio-proxy/1.log" Jul 07 07:39:55.380940 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:55.380883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dcff594f7-w7xr6_7a1f9c3e-403d-4bc1-89a3-3d48e64530dd/router/0.log" Jul 07 07:39:56.173354 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:56.173329 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zwr9g/perf-node-gather-daemonset-9sjl5" Jul 07 07:39:56.202956 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:56.202924 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-29ghm_e484a269-46ab-4d05-9c32-6ab0c7e58d7e/serve-healthcheck-canary/0.log" Jul 07 07:39:57.133292 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:57.133242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp2zz_d5da8052-2965-416d-b290-d79c85a59e68/kube-rbac-proxy/0.log" Jul 07 07:39:57.168064 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:57.168037 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp2zz_d5da8052-2965-416d-b290-d79c85a59e68/exporter/0.log" Jul 07 07:39:57.213785 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:57.213757 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dp2zz_d5da8052-2965-416d-b290-d79c85a59e68/extractor/0.log" Jul 07 07:39:59.018820 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:59.018789 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fdtqw_c2de6520-4a95-4908-87dd-9a9b8b3d22f2/istio-proxy/0.log" Jul 07 07:39:59.195861 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:59.195776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h26rd_3d741e70-65e3-4375-92fb-51f48cb6e371/istio-proxy/0.log" Jul 07 07:39:59.246350 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:59.246313 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h26rd_3d741e70-65e3-4375-92fb-51f48cb6e371/istio-proxy/1.log" Jul 07 07:39:59.346244 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:39:59.346209 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dcff594f7-w7xr6_7a1f9c3e-403d-4bc1-89a3-3d48e64530dd/router/0.log" Jul 07 07:40:00.120631 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:40:00.120603 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723475-sr874_47c41d51-5f23-436c-bdc4-fae1a9057093/cleanup/0.log" Jul 07 07:40:00.385230 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:40:00.385140 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbf9cc589-cj7hb_9633bb19-6f0a-414a-abfe-31ac61e45e20/manager/0.log" Jul 07 07:40:00.410844 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:40:00.410820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbf9cc589-cj7hb_9633bb19-6f0a-414a-abfe-31ac61e45e20/copy-manifests/0.log" Jul 07 07:40:00.566480 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:40:00.566446 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fdtqw_c2de6520-4a95-4908-87dd-9a9b8b3d22f2/istio-proxy/0.log" Jul 07 07:40:00.728688 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:40:00.728575 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h26rd_3d741e70-65e3-4375-92fb-51f48cb6e371/istio-proxy/0.log" Jul 07 07:40:00.792335 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:40:00.792301 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h26rd_3d741e70-65e3-4375-92fb-51f48cb6e371/istio-proxy/1.log" Jul 07 07:40:00.874394 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:40:00.874366 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dcff594f7-w7xr6_7a1f9c3e-403d-4bc1-89a3-3d48e64530dd/router/0.log" Jul 07 07:40:02.022117 ip-10-0-138-175 kubenswrapper[2565]: I0707 07:40:02.022084 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c6f759dd-q2v7m_fb347d3b-2068-4c27-8a1f-4ced8b174fa9/manager/0.log"