Jul 08 21:30:51.470371 ip-10-0-143-77 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 21:30:51.470384 ip-10-0-143-77 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 21:30:51.470395 ip-10-0-143-77 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 21:30:51.470745 ip-10-0-143-77 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 21:31:01.599660 ip-10-0-143-77 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 21:31:01.599681 ip-10-0-143-77 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0c3905ccc84f47509da142e84dafdc19 -- Jul 08 21:33:01.407852 ip-10-0-143-77 systemd[1]: Starting Kubernetes Kubelet... Jul 08 21:33:01.812353 ip-10-0-143-77 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 21:33:01.812353 ip-10-0-143-77 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 21:33:01.812353 ip-10-0-143-77 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 21:33:01.812353 ip-10-0-143-77 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 21:33:01.812353 ip-10-0-143-77 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 21:33:01.813059 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.812966 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 21:33:01.818932 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818910 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 21:33:01.818932 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818931 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818955 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818967 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818970 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818973 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818976 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818979 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818981 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818984 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818986 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818989 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818992 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818994 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818997 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.818999 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819002 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819004 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819011 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819015 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819018 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 21:33:01.819014 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819021 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819025 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819028 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819030 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819033 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819035 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819038 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819040 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819043 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819045 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819048 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819050 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819053 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819055 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819064 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819066 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819069 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819072 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819074 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819077 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 21:33:01.819476 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819079 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819082 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819085 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819087 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819092 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819095 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819098 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819101 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819103 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819105 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819108 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819110 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819113 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819115 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819119 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819121 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819125 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819128 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819131 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 21:33:01.819970 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819134 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819136 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819139 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819141 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819144 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819146 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819149 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819151 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819159 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819162 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819166 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819168 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819171 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819173 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819176 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819178 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819181 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819183 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819186 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819188 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 21:33:01.820429 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819190 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819193 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819195 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819197 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819201 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819204 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819207 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819211 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819214 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819216 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819219 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819222 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819224 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819227 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819229 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819232 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819235 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819237 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.819239 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820030 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 21:33:01.820982 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820036 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820040 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820043 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820045 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820048 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820051 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820054 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820056 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820059 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820061 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820064 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820067 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820069 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820072 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820075 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820077 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820080 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820082 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820085 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 21:33:01.821499 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820089 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820091 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820094 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820096 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820101 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820105 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820108 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820111 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820114 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820117 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820119 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820122 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820125 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820128 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820131 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820134 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820138 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820141 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820143 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 21:33:01.822019 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820146 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820149 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820151 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820154 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820156 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820159 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820162 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820164 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820167 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820169 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820172 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820175 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820177 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820180 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820182 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820185 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820188 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820190 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820192 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820195 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 21:33:01.822725 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820197 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820200 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820202 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820205 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820207 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820210 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820212 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820215 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820218 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820220 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820223 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820227 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820230 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820233 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820236 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820238 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820241 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820243 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820246 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 21:33:01.823655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820248 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820251 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820254 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820258 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820261 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820264 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820267 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820270 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820272 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820275 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820277 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820280 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820282 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820285 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820287 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820290 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820292 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820295 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820297 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820300 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 21:33:01.824457 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.820302 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822891 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822908 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822914 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822920 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822925 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822930 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822934 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822939 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822943 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822948 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822960 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822964 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822968 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822973 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822978 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822982 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822986 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822990 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 21:33:01.825181 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.822994 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823001 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823006 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823011 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823016 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823021 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823025 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823030 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823035 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823040 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823044 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823050 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823054 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823058 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823063 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823069 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823073 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823077 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823082 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 21:33:01.825723 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823086 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823090 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823094 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823098 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823102 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823106 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823111 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823115 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823119 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823123 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823127 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823131 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823135 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823141 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823145 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823149 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823153 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823157 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823161 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823166 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 21:33:01.826244 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823169 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823173 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823179 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823185 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823189 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823194 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823198 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823202 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823207 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823211 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823215 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823219 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823224 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823228 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823232 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823237 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823241 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823245 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823249 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823253 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 21:33:01.826963 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823257 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823261 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823265 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823270 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823274 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823278 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823284 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823288 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823294 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823298 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823302 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823309 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823314 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823318 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823324 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823330 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823335 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823340 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823345 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823350 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 21:33:01.827521 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823354 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.823358 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823470 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823482 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823493 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823500 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823524 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823529 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823536 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823543 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823548 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823553 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823558 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823563 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823569 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823574 2559 flags.go:64] FLAG: --cgroup-root="" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823579 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823584 2559 flags.go:64] FLAG: --client-ca-file="" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823589 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823594 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823601 2559 flags.go:64] FLAG: --cluster-domain="" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823605 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823611 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823619 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 21:33:01.828012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823624 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823630 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823635 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823640 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823645 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823650 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823655 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823659 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823664 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823668 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823674 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823679 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823684 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823688 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823693 2559 flags.go:64] FLAG: --enable-server="true" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823698 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823706 2559 flags.go:64] FLAG: --event-burst="100" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823711 2559 flags.go:64] FLAG: --event-qps="50" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823716 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823720 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823725 2559 flags.go:64] FLAG: --eviction-hard="" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823732 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823737 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823742 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823747 2559 flags.go:64] FLAG: --eviction-soft="" Jul 08 21:33:01.828695 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823752 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823756 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823761 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823766 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823771 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823775 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823780 2559 flags.go:64] FLAG: --feature-gates="" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823787 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823792 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823797 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823802 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823807 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823814 2559 flags.go:64] FLAG: --help="false" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823819 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-77.ec2.internal" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823825 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823829 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823834 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823840 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823846 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823850 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823855 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823859 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823864 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 21:33:01.829301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823868 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823874 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823878 2559 flags.go:64] FLAG: --kube-reserved="" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823883 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823888 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823893 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823897 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823902 2559 flags.go:64] FLAG: --lock-file="" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823907 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823912 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823917 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823926 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823930 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823935 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823941 2559 flags.go:64] FLAG: --logging-format="text" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823945 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823951 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823955 2559 flags.go:64] FLAG: --manifest-url="" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823959 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823967 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823972 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823981 2559 flags.go:64] FLAG: --max-pods="110" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823987 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823991 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.823996 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 21:33:01.829939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824001 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824005 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824010 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824014 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824025 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824029 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824034 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824039 2559 flags.go:64] FLAG: --pod-cidr="" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824044 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824054 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824058 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824063 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824068 2559 flags.go:64] FLAG: --port="10250" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824073 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824078 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06a62274f2fa32fd8" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824083 2559 flags.go:64] FLAG: --qos-reserved="" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824087 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824092 2559 flags.go:64] FLAG: --register-node="true" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824097 2559 flags.go:64] FLAG: --register-with-taints="" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824103 2559 flags.go:64] FLAG: --registry-burst="10" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824108 2559 flags.go:64] FLAG: --registry-qps="5" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824113 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824118 2559 flags.go:64] FLAG: --reserved-memory="" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824125 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824130 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 21:33:01.830552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824135 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824139 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824144 2559 flags.go:64] FLAG: --runonce="false" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824148 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824156 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824160 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824165 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824170 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824175 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824180 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824185 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824190 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824194 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824199 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824204 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824208 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824213 2559 flags.go:64] FLAG: --system-cgroups="" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824218 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824227 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824232 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824237 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824243 2559 flags.go:64] FLAG: --tls-min-version="" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824247 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824252 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824257 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 21:33:01.831213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824261 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824266 2559 flags.go:64] FLAG: --v="2" Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824273 2559 flags.go:64] FLAG: --version="false" Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824279 2559 flags.go:64] FLAG: --vmodule="" Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824287 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.824293 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824474 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824480 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824486 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824491 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824495 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824519 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824525 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824530 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824534 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824539 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824543 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824547 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824551 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824559 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 21:33:01.831834 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824565 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824570 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824575 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824579 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824584 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824588 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824592 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824597 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824602 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824606 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824610 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824614 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824618 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824622 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824626 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824630 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824635 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824642 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824648 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 21:33:01.832319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824653 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824657 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824661 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824665 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824671 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824676 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824680 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824684 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824688 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824692 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824696 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824701 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824707 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824711 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824715 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824720 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824725 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824729 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824733 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824737 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 21:33:01.832815 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824741 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824745 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824749 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824753 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824758 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824762 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824767 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824771 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824775 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824779 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824783 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824788 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824792 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824796 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824800 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824804 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824810 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824814 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824818 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824822 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 21:33:01.833302 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824826 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824830 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824834 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824839 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824846 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824852 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824857 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824861 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824865 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824869 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824874 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824877 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824882 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824886 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824890 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824894 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824898 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824902 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824907 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 21:33:01.833806 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824911 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824915 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824919 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824923 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824927 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824932 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.824936 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.825615 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.832784 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.832802 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.833643 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.833651 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833716 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833721 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833725 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 21:33:01.834291 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833728 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833731 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833735 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833737 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833740 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833743 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833746 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833748 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833751 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833753 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833756 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833759 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833762 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833764 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833767 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833770 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833772 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833775 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833778 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833780 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 21:33:01.834688 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833784 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833786 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833789 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833791 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833794 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833797 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833801 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833804 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833809 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833813 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833816 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833819 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833822 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833825 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833828 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833830 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833833 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833835 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833838 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 21:33:01.835211 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833840 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833844 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833849 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833853 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833856 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833860 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833863 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833866 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833868 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833871 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833874 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833877 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833879 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833882 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833884 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833887 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833890 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833893 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833896 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 21:33:01.835695 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833899 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833903 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833906 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833908 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833911 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833914 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833916 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833919 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833922 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833924 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833927 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833929 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833932 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833935 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833937 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833940 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833943 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833945 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833947 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833950 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 21:33:01.836149 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833953 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833955 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833958 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833960 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833963 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833965 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833968 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833970 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833972 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833975 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833977 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833980 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833983 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833986 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833990 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833992 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833995 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 21:33:01.836655 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.833997 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.834003 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834122 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834127 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834130 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834133 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834135 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834138 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834141 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834143 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834146 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834149 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834152 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834155 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 21:33:01.837063 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834157 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834160 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834163 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834165 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834168 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834171 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834173 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834175 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834178 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834181 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834183 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834186 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834188 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834191 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834194 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834197 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834200 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834203 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834205 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834208 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834211 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 21:33:01.837407 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834213 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834216 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834218 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834221 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834223 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834226 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834228 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834230 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834233 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834235 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834238 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834240 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834243 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834245 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834248 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834251 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834254 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834256 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834259 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834261 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 21:33:01.837949 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834263 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834266 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834268 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834272 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834275 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834279 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834281 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834284 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834287 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834289 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834292 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834295 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834297 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834300 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834302 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834305 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834307 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834310 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834313 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 21:33:01.838423 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834317 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834320 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834323 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834326 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834329 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834331 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834334 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834337 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834340 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834344 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834347 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834350 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834353 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834356 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834360 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834362 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834365 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834368 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834371 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834374 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 21:33:01.838912 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834377 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834379 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834382 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834385 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834388 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834390 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:01.834393 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.834398 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.834573 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.836571 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.837925 2559 server.go:1019] "Starting client certificate rotation" Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.838034 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 21:33:01.839409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.838095 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 21:33:01.840545 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.840532 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 21:33:01.841736 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.841719 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 21:33:01.849685 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.849660 2559 log.go:25] "Validated CRI v1 runtime API" Jul 08 21:33:01.851693 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.851673 2559 log.go:25] "Validated CRI v1 image API" Jul 08 21:33:01.854886 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.854863 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 21:33:01.857479 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.857458 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c98cd363-5149-4c40-9427-65fd318e3a41:/dev/nvme0n1p4 d0dbae99-0f84-44ae-a45b-dfbef4c950a4:/dev/nvme0n1p3] Jul 08 21:33:01.857570 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.857477 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 21:33:01.862903 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.862776 2559 manager.go:216] Machine: {Timestamp:2026-07-08 21:33:01.861411647 +0000 UTC m=+0.339419510 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124181 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21bc6b7db029d97d53174bd754bae4 SystemUUID:ec21bc6b-7db0-29d9-7d53-174bd754bae4 BootID:0c3905cc-c84f-4750-9da1-42e84dafdc19 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e3:2d:ef:f3:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e3:2d:ef:f3:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:44:9e:6f:5b:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 21:33:01.862903 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.862895 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 21:33:01.863063 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.863050 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 21:33:01.866239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.866203 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 21:33:01.866380 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.866364 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 21:33:01.866380 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.866242 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 21:33:01.866890 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.866879 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 21:33:01.866929 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.866891 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 21:33:01.866929 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.866899 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 21:33:01.867518 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.867498 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 21:33:01.868259 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.868249 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 21:33:01.871980 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.871965 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 08 21:33:01.872111 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.872102 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 21:33:01.872145 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.872135 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 08 21:33:01.872176 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.872153 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 21:33:01.872176 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.872168 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 21:33:01.872227 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.872178 2559 kubelet.go:398] "Adding apiserver pod source" Jul 08 21:33:01.872227 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.872190 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 21:33:01.872612 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.872599 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 21:33:01.872646 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.872622 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 21:33:01.874961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.874932 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 21:33:01.876333 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.876320 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 21:33:01.876384 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.876350 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 21:33:01.877363 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877351 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 21:33:01.877402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877367 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 21:33:01.877402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877373 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 21:33:01.877402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877379 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 21:33:01.877402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877387 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 21:33:01.877402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877392 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 21:33:01.877402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877400 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 21:33:01.877583 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877405 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 21:33:01.877583 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877412 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 21:33:01.877583 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877418 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 21:33:01.877583 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877434 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 21:33:01.877583 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.877440 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 21:33:01.878239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.878229 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 21:33:01.878239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.878239 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 21:33:01.881464 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.881444 2559 server.go:1268] "Started kubelet" Jul 08 21:33:01.881592 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.881555 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 21:33:01.881676 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.881557 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 21:33:01.881755 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.881693 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 21:33:01.882312 ip-10-0-143-77 systemd[1]: Started Kubernetes Kubelet. Jul 08 21:33:01.882563 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.882518 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 21:33:01.882563 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.882520 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 21:33:01.883121 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.883085 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 21:33:01.883192 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.883170 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 21:33:01.883622 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.883602 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 08 21:33:01.888746 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.888719 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 21:33:01.889753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.889733 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9m8r7" Jul 08 21:33:01.890744 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.889492 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-77.ec2.internal.18c06dfc1479ac3c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-77.ec2.internal,UID:ip-10-0-143-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-77.ec2.internal,},FirstTimestamp:2026-07-08 21:33:01.88142086 +0000 UTC m=+0.359428722,LastTimestamp:2026-07-08 21:33:01.88142086 +0000 UTC m=+0.359428722,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-77.ec2.internal,}" Jul 08 21:33:01.891980 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.891966 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 21:33:01.892033 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.891988 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 21:33:01.892090 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.892070 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:01.892684 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.892610 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 21:33:01.892799 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.892778 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 21:33:01.892869 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.892803 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 21:33:01.892869 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.892782 2559 factory.go:55] Registering systemd factory Jul 08 21:33:01.892869 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.892858 2559 factory.go:223] Registration of the systemd container factory successfully Jul 08 21:33:01.893004 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.892960 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 08 21:33:01.893004 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.892971 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 08 21:33:01.893144 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.893130 2559 factory.go:153] Registering CRI-O factory Jul 08 21:33:01.893211 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.893148 2559 factory.go:223] Registration of the crio container factory successfully Jul 08 21:33:01.893211 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.893207 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 21:33:01.893308 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.893231 2559 factory.go:103] Registering Raw factory Jul 08 21:33:01.893308 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.893246 2559 manager.go:1196] Started watching for new ooms in manager Jul 08 21:33:01.893654 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.893640 2559 manager.go:349] Starting recovery of all containers Jul 08 21:33:01.895410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.895386 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9m8r7" Jul 08 21:33:01.897848 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.897823 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 21:33:01.897969 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.897936 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 21:33:01.905337 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.905322 2559 manager.go:354] Recovery completed Jul 08 21:33:01.910207 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.910192 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 21:33:01.915602 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.915584 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory" Jul 08 21:33:01.915665 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.915616 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 21:33:01.915665 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.915633 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID" Jul 08 21:33:01.916267 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.916254 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 21:33:01.916267 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.916265 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 21:33:01.916267 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.916269 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 21:33:01.916406 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.916282 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 08 21:33:01.917114 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.917095 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory" Jul 08 21:33:01.917186 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.917124 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 21:33:01.917186 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.917143 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID" Jul 08 21:33:01.918168 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.918153 2559 policy_none.go:49] "None policy: Start" Jul 08 21:33:01.918210 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.918177 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 21:33:01.918210 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.918192 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 21:33:01.920031 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.920019 2559 policy_none.go:47] "Start" Jul 08 21:33:01.961337 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.961303 2559 manager.go:337] "Starting Device Plugin manager" Jul 08 21:33:01.961460 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.961354 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 21:33:01.961460 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.961370 2559 server.go:87] "Starting device plugin registration server" Jul 08 21:33:01.961702 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.961689 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 21:33:01.961737 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.961707 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 21:33:01.961816 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.961794 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 21:33:01.961939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.961918 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 21:33:01.961939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:01.961936 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 21:33:01.962435 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.962415 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 21:33:01.962525 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:01.962463 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:02.062053 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.062014 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 21:33:02.064239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.063069 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory" Jul 08 21:33:02.064239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.063100 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 21:33:02.064239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.063115 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID" Jul 08 21:33:02.064239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.063146 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.071479 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.071454 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.071636 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:02.071486 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-77.ec2.internal\": node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:02.071757 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.071729 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 21:33:02.073105 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.073090 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 21:33:02.073189 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.073126 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 21:33:02.073189 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.073149 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 21:33:02.073189 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:02.073183 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 21:33:02.075430 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.075403 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 21:33:02.118795 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:02.118762 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:02.173810 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.173761 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal"] Jul 08 21:33:02.173898 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.173847 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 21:33:02.174854 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.174837 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory" Jul 08 21:33:02.174977 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.174872 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 21:33:02.174977 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.174888 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID" Jul 08 21:33:02.177260 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.177244 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 21:33:02.177365 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.177351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.177426 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.177380 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 21:33:02.177991 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.177974 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory" Jul 08 21:33:02.178068 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.178002 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 21:33:02.178068 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.178019 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID" Jul 08 21:33:02.178148 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.178082 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory" Jul 08 21:33:02.178148 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.178100 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 21:33:02.178148 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.178108 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID" Jul 08 21:33:02.180272 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.180256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.180351 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.180284 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 21:33:02.187358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.187334 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory" Jul 08 21:33:02.187431 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.187368 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 21:33:02.187431 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.187379 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID" Jul 08 21:33:02.195605 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.195576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a635b78dfde69bf143c48d7a0ccb7ef8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"a635b78dfde69bf143c48d7a0ccb7ef8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.195691 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.195613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a635b78dfde69bf143c48d7a0ccb7ef8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"a635b78dfde69bf143c48d7a0ccb7ef8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.195691 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.195631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbda490fa50675fa459f3fc992f874a7-config\") pod \"kube-apiserver-proxy-ip-10-0-143-77.ec2.internal\" (UID: \"bbda490fa50675fa459f3fc992f874a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.198236 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:02.198216 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-77.ec2.internal\" not found" node="ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.204380 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:02.204364 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-77.ec2.internal\" not found" node="ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.219476 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:02.219451 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:02.296251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.296218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a635b78dfde69bf143c48d7a0ccb7ef8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"a635b78dfde69bf143c48d7a0ccb7ef8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.296251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.296253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbda490fa50675fa459f3fc992f874a7-config\") pod \"kube-apiserver-proxy-ip-10-0-143-77.ec2.internal\" (UID: \"bbda490fa50675fa459f3fc992f874a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.296474 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.296275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a635b78dfde69bf143c48d7a0ccb7ef8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"a635b78dfde69bf143c48d7a0ccb7ef8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.296474 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.296330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a635b78dfde69bf143c48d7a0ccb7ef8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"a635b78dfde69bf143c48d7a0ccb7ef8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.296474 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.296337 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbda490fa50675fa459f3fc992f874a7-config\") pod \"kube-apiserver-proxy-ip-10-0-143-77.ec2.internal\" (UID: \"bbda490fa50675fa459f3fc992f874a7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.296474 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.296371 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a635b78dfde69bf143c48d7a0ccb7ef8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"a635b78dfde69bf143c48d7a0ccb7ef8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.319570 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:02.319544 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:02.420311 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:02.420270 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:02.500866 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.500840 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:02.506584 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:02.506565 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" Jul 08 21:33:03.885659 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:03.885635 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:03.986200 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:03.986112 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found" Jul 08 21:33:04.080132 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.080101 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 21:33:04.158149 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.158116 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" Jul 08 21:33:04.169567 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.169547 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 21:33:04.171398 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.171382 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" Jul 08 21:33:04.177893 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.177878 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 21:33:04.202059 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.202033 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 21:33:04.202222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.202176 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 21:33:04.202222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.202195 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 21:33:04.224329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.224303 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 21:33:04.238164 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.238099 2559 apiserver.go:52] "Watching apiserver" Jul 08 21:33:04.244556 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.244536 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 21:33:04.246415 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.246398 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 21:33:04.247219 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.247200 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46","openshift-image-registry/node-ca-44cx7","openshift-multus/multus-additional-cni-plugins-f9fng","openshift-multus/network-metrics-daemon-rszm5","openshift-network-diagnostics/network-check-target-k2sg5","openshift-ovn-kubernetes/ovnkube-node-v76jx","kube-system/global-pull-secret-syncer-wffhf","kube-system/konnectivity-agent-vx886","kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nmrzv","openshift-dns/node-resolver-792s4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal","openshift-multus/multus-pbcmq","openshift-network-operator/iptables-alerter-9rlpl"] Jul 08 21:33:04.249699 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.249680 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.249784 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.249749 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:04.251756 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.251738 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.253937 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.253875 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.254014 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.253879 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 21:33:04.255510 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.254305 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 21:33:04.255510 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.254579 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 21:33:04.255510 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.254810 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 21:33:04.255510 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.255332 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6z56\"" Jul 08 21:33:04.256631 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.256593 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:04.257074 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.257044 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:04.257179 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.257086 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 21:33:04.257179 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.257120 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 21:33:04.257321 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.257308 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m498v\"" Jul 08 21:33:04.257363 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.257335 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 21:33:04.259192 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.259175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:04.259255 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.259236 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:04.261430 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.261414 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.263422 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.263401 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 21:33:04.263511 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.263471 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 21:33:04.263511 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.263496 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 21:33:04.263635 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.263533 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 21:33:04.263800 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.263784 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.263876 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.263843 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g9drp\"" Jul 08 21:33:04.263923 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.263898 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 21:33:04.264024 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264002 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 21:33:04.264340 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q2vs\" (UniqueName: \"kubernetes.io/projected/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-kube-api-access-9q2vs\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.264392 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-k8s-cni-cncf-io\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264392 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-786nh\" (UniqueName: \"kubernetes.io/projected/031fa896-6c07-4e1c-9044-7ee0a6951a3c-kube-api-access-786nh\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264468 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-system-cni-dir\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.264468 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-os-release\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.264569 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-dbus\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.264569 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264453 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 21:28:03 +0000 UTC" deadline="2028-01-13 16:30:37.310670186 +0000 UTC" Jul 08 21:33:04.264569 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264497 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13290h57m33.046176032s" Jul 08 21:33:04.264569 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/031fa896-6c07-4e1c-9044-7ee0a6951a3c-cni-binary-copy\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264569 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-kubelet\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264569 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264570 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-cnibin\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-cni-bin\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-kubelet-config\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-system-cni-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-cni-multus\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-daemon-config\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-etc-kubernetes\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmf9x\" (UniqueName: \"kubernetes.io/projected/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-kube-api-access-xmf9x\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264786 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.264828 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-cni-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-socket-dir-parent\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-netns\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-os-release\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-conf-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cnibin\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.264997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-hostroot\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.265030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-multus-certs\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.265059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.265086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.265251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.265108 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.266428 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.265763 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 21:33:04.266428 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.265889 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.266428 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.265967 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 21:33:04.266428 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.266030 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxhlp\"" Jul 08 21:33:04.266428 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.266217 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 21:33:04.267786 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.267759 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 21:33:04.267949 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.267931 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 21:33:04.268031 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.268004 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 21:33:04.268090 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.268068 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5s4m9\"" Jul 08 21:33:04.268187 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.268172 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.268714 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.268699 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 21:33:04.270101 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.270087 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 21:33:04.270172 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.270163 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 21:33:04.270402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.270375 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 21:33:04.270402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.270378 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dv2jj\"" Jul 08 21:33:04.270528 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.270464 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.272592 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.272576 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m6kjl\"" Jul 08 21:33:04.272644 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.272597 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 21:33:04.272700 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.272685 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 21:33:04.272848 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.272835 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.274887 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.274873 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 21:33:04.274972 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.274961 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 21:33:04.275034 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.275007 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5dg8n\"" Jul 08 21:33:04.275168 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.275154 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:04.277058 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.277037 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 21:33:04.277205 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.277185 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 21:33:04.277301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.277266 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f6mpv\"" Jul 08 21:33:04.287709 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.287686 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckd8m" Jul 08 21:33:04.295380 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.295363 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckd8m" Jul 08 21:33:04.358464 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.358438 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 21:33:04.365342 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-cni-multus\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.365439 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-daemon-config\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.365439 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbr9g\" (UniqueName: \"kubernetes.io/projected/e026841a-477f-4e0c-87ed-e4e0d160b9d0-kube-api-access-vbr9g\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.365439 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-modprobe-d\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.365439 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-cni-multus\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.365439 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-systemd\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-run-netns\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-cni-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-run\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-host\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w67fc\" (UniqueName: \"kubernetes.io/projected/ea5c4287-d7ea-4953-8883-a7d627071421-kube-api-access-w67fc\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365645 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-cni-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-socket-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-node-log\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.365712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovnkube-config\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2p75\" (UniqueName: \"kubernetes.io/projected/26355e38-8733-43cf-a4ad-fde077a7d6ca-kube-api-access-b2p75\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365754 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-lib-modules\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365771 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-hostroot\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-hostroot\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87e5bf7a-f29e-48f2-98c4-7554baa9c483-agent-certs\") pod \"konnectivity-agent-vx886\" (UID: \"87e5bf7a-f29e-48f2-98c4-7554baa9c483\") " pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87e5bf7a-f29e-48f2-98c4-7554baa9c483-konnectivity-ca\") pod \"konnectivity-agent-vx886\" (UID: \"87e5bf7a-f29e-48f2-98c4-7554baa9c483\") " pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q2vs\" (UniqueName: \"kubernetes.io/projected/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-kube-api-access-9q2vs\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.365995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-os-release\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-daemon-config\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-systemd\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/031fa896-6c07-4e1c-9044-7ee0a6951a3c-cni-binary-copy\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.366222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-kubelet\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-iptables-alerter-script\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-os-release\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366306 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-kubelet\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysconfig\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-device-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-sys-fs\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-log-socket\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-cni-bin\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-env-overrides\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysctl-d\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366602 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-var-lib-kubelet\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea5c4287-d7ea-4953-8883-a7d627071421-tmp-dir\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/031fa896-6c07-4e1c-9044-7ee0a6951a3c-cni-binary-copy\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmpgn\" (UniqueName: \"kubernetes.io/projected/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-kube-api-access-pmpgn\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.367067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4993f060-dc4a-4eb7-8e3e-1691911e1f12-tmp\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-etc-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-system-cni-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-etc-kubernetes\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmf9x\" (UniqueName: \"kubernetes.io/projected/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-kube-api-access-xmf9x\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-registration-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-system-cni-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovnkube-script-lib\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-etc-kubernetes\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysctl-conf\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea5c4287-d7ea-4953-8883-a7d627071421-hosts-file\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-serviceca\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.366984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-socket-dir-parent\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-netns\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-host-slash\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-socket-dir-parent\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-netns\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.367820 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-os-release\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-conf-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367160 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cnibin\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367183 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-multus-conf-dir\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367184 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-os-release\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367203 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cnibin\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367184 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-slash\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.367311 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-cni-netd\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.367380 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs podName:c83c1b24-4d75-435c-8806-d2e2e1ac0e6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:04.867354523 +0000 UTC m=+1.980349234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs") pod "network-metrics-daemon-rszm5" (UID: "c83c1b24-4d75-435c-8806-d2e2e1ac0e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-tuned\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-multus-certs\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-multus-certs\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.368425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovn-node-metrics-cert\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.367583 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-k8s-cni-cncf-io\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-786nh\" (UniqueName: \"kubernetes.io/projected/031fa896-6c07-4e1c-9044-7ee0a6951a3c-kube-api-access-786nh\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-system-cni-dir\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.367663 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret podName:58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:04.867650139 +0000 UTC m=+1.980644835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret") pod "global-pull-secret-syncer-wffhf" (UID: "58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d") : object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367665 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-run-k8s-cni-cncf-io\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367680 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-system-cni-dir\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-dbus\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-ovn\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8gsd\" (UniqueName: \"kubernetes.io/projected/4993f060-dc4a-4eb7-8e3e-1691911e1f12-kube-api-access-x8gsd\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-sys\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-cnibin\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367766 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-cni-bin\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367802 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-host-var-lib-cni-bin\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-var-lib-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.368981 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/031fa896-6c07-4e1c-9044-7ee0a6951a3c-cnibin\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-kubernetes\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367861 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-dbus\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-kubelet-config\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-host\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-kubelet\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfd2t\" (UniqueName: \"kubernetes.io/projected/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-kube-api-access-hfd2t\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-kubelet-config\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.367990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-systemd-units\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.368026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.368044 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.369489 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.368395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.371476 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.371460 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 21:33:04.371476 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.371476 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 21:33:04.371598 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.371485 2559 projected.go:196] Error preparing data for projected volume kube-api-access-czcvz for pod openshift-network-diagnostics/network-check-target-k2sg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:04.371598 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.371559 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz podName:adce1b77-3f45-41ab-bebf-c46606b14e74 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:04.87154618 +0000 UTC m=+1.984540877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-czcvz" (UniqueName: "kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz") pod "network-check-target-k2sg5" (UID: "adce1b77-3f45-41ab-bebf-c46606b14e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:04.371761 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.371680 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 21:33:04.375087 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.375067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmf9x\" (UniqueName: \"kubernetes.io/projected/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-kube-api-access-xmf9x\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:04.375171 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.375106 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q2vs\" (UniqueName: \"kubernetes.io/projected/d9cd29c1-4f21-4d00-b8f8-9ad130e0979f-kube-api-access-9q2vs\") pod \"multus-additional-cni-plugins-f9fng\" (UID: \"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f\") " pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.375171 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.375106 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-786nh\" (UniqueName: \"kubernetes.io/projected/031fa896-6c07-4e1c-9044-7ee0a6951a3c-kube-api-access-786nh\") pod \"multus-pbcmq\" (UID: \"031fa896-6c07-4e1c-9044-7ee0a6951a3c\") " pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.468653 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-host\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.468653 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-kubelet\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfd2t\" (UniqueName: \"kubernetes.io/projected/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-kube-api-access-hfd2t\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-systemd-units\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468739 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-kubelet\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbr9g\" (UniqueName: \"kubernetes.io/projected/e026841a-477f-4e0c-87ed-e4e0d160b9d0-kube-api-access-vbr9g\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468741 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-host\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-modprobe-d\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-systemd\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-run-netns\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-systemd-units\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-run\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-host\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-modprobe-d\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w67fc\" (UniqueName: \"kubernetes.io/projected/ea5c4287-d7ea-4953-8883-a7d627071421-kube-api-access-w67fc\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-run\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-run-netns\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.468953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-host\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-systemd\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.468993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-socket-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-node-log\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovnkube-config\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-node-log\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2p75\" (UniqueName: \"kubernetes.io/projected/26355e38-8733-43cf-a4ad-fde077a7d6ca-kube-api-access-b2p75\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-socket-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-lib-modules\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469179 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87e5bf7a-f29e-48f2-98c4-7554baa9c483-agent-certs\") pod \"konnectivity-agent-vx886\" (UID: \"87e5bf7a-f29e-48f2-98c4-7554baa9c483\") " pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87e5bf7a-f29e-48f2-98c4-7554baa9c483-konnectivity-ca\") pod \"konnectivity-agent-vx886\" (UID: \"87e5bf7a-f29e-48f2-98c4-7554baa9c483\") " pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469220 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-run-ovn-kubernetes\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-systemd\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-lib-modules\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-iptables-alerter-script\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.469732 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469341 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysconfig\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-systemd\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469401 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-device-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-sys-fs\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysconfig\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-log-socket\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469508 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-device-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-cni-bin\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-sys-fs\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-env-overrides\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469582 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-log-socket\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysctl-d\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-cni-bin\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-var-lib-kubelet\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.470552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea5c4287-d7ea-4953-8883-a7d627071421-tmp-dir\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-var-lib-kubelet\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmpgn\" (UniqueName: \"kubernetes.io/projected/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-kube-api-access-pmpgn\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469702 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysctl-d\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469707 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4993f060-dc4a-4eb7-8e3e-1691911e1f12-tmp\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovnkube-config\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-etc-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-registration-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovnkube-script-lib\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysctl-conf\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea5c4287-d7ea-4953-8883-a7d627071421-hosts-file\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-serviceca\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-host-slash\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469929 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87e5bf7a-f29e-48f2-98c4-7554baa9c483-konnectivity-ca\") pod \"konnectivity-agent-vx886\" (UID: \"87e5bf7a-f29e-48f2-98c4-7554baa9c483\") " pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469947 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-iptables-alerter-script\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.471358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.469989 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea5c4287-d7ea-4953-8883-a7d627071421-hosts-file\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-slash\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470005 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-registration-dir\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-env-overrides\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-cni-netd\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470036 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-etc-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-tuned\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470050 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea5c4287-d7ea-4953-8883-a7d627071421-tmp-dir\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-slash\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470061 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-sysctl-conf\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovn-node-metrics-cert\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470124 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e026841a-477f-4e0c-87ed-e4e0d160b9d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470124 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470151 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-host-cni-netd\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470239 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-ovn\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-host-slash\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-serviceca\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470450 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8gsd\" (UniqueName: \"kubernetes.io/projected/4993f060-dc4a-4eb7-8e3e-1691911e1f12-kube-api-access-x8gsd\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-sys\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-var-lib-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-kubernetes\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470653 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-kubernetes\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470698 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4993f060-dc4a-4eb7-8e3e-1691911e1f12-sys\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470843 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovnkube-script-lib\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-var-lib-openvswitch\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.470921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/26355e38-8733-43cf-a4ad-fde077a7d6ca-run-ovn\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.472278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4993f060-dc4a-4eb7-8e3e-1691911e1f12-etc-tuned\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.472389 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/26355e38-8733-43cf-a4ad-fde077a7d6ca-ovn-node-metrics-cert\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.472441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4993f060-dc4a-4eb7-8e3e-1691911e1f12-tmp\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.472783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.472486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87e5bf7a-f29e-48f2-98c4-7554baa9c483-agent-certs\") pod \"konnectivity-agent-vx886\" (UID: \"87e5bf7a-f29e-48f2-98c4-7554baa9c483\") " pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:04.477185 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.476999 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbr9g\" (UniqueName: \"kubernetes.io/projected/e026841a-477f-4e0c-87ed-e4e0d160b9d0-kube-api-access-vbr9g\") pod \"aws-ebs-csi-driver-node-mxb46\" (UID: \"e026841a-477f-4e0c-87ed-e4e0d160b9d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.477305 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.477198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2p75\" (UniqueName: \"kubernetes.io/projected/26355e38-8733-43cf-a4ad-fde077a7d6ca-kube-api-access-b2p75\") pod \"ovnkube-node-v76jx\" (UID: \"26355e38-8733-43cf-a4ad-fde077a7d6ca\") " pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.477587 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.477569 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmpgn\" (UniqueName: \"kubernetes.io/projected/4b2fd010-44cc-44ce-9813-3c399cf7f0e5-kube-api-access-pmpgn\") pod \"iptables-alerter-9rlpl\" (UID: \"4b2fd010-44cc-44ce-9813-3c399cf7f0e5\") " pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.477688 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.477669 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w67fc\" (UniqueName: \"kubernetes.io/projected/ea5c4287-d7ea-4953-8883-a7d627071421-kube-api-access-w67fc\") pod \"node-resolver-792s4\" (UID: \"ea5c4287-d7ea-4953-8883-a7d627071421\") " pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.478116 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.478095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfd2t\" (UniqueName: \"kubernetes.io/projected/dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6-kube-api-access-hfd2t\") pod \"node-ca-44cx7\" (UID: \"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6\") " pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.479074 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.479055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8gsd\" (UniqueName: \"kubernetes.io/projected/4993f060-dc4a-4eb7-8e3e-1691911e1f12-kube-api-access-x8gsd\") pod \"tuned-nmrzv\" (UID: \"4993f060-dc4a-4eb7-8e3e-1691911e1f12\") " pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.515417 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.515375 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda635b78dfde69bf143c48d7a0ccb7ef8.slice/crio-0a6fa5e958d867a24c10952eea260f21c5a090ab82bba0c4d517affb53527c89 WatchSource:0}: Error finding container 0a6fa5e958d867a24c10952eea260f21c5a090ab82bba0c4d517affb53527c89: Status 404 returned error can't find the container with id 0a6fa5e958d867a24c10952eea260f21c5a090ab82bba0c4d517affb53527c89 Jul 08 21:33:04.515633 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.515614 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbda490fa50675fa459f3fc992f874a7.slice/crio-a7ee485457c57973222254bd924e8b642a6a906e662c9e24cb258218e3be9606 WatchSource:0}: Error finding container a7ee485457c57973222254bd924e8b642a6a906e662c9e24cb258218e3be9606: Status 404 returned error can't find the container with id a7ee485457c57973222254bd924e8b642a6a906e662c9e24cb258218e3be9606 Jul 08 21:33:04.521636 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.521619 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 21:33:04.579256 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.579213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pbcmq" Jul 08 21:33:04.588671 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.588647 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031fa896_6c07_4e1c_9044_7ee0a6951a3c.slice/crio-e9b304b41f679b85fc1326c0f7a222f44de7e4890981bca5a6dd8aba07a9a0bb WatchSource:0}: Error finding container e9b304b41f679b85fc1326c0f7a222f44de7e4890981bca5a6dd8aba07a9a0bb: Status 404 returned error can't find the container with id e9b304b41f679b85fc1326c0f7a222f44de7e4890981bca5a6dd8aba07a9a0bb Jul 08 21:33:04.597144 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.597123 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f9fng" Jul 08 21:33:04.605088 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.605065 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cd29c1_4f21_4d00_b8f8_9ad130e0979f.slice/crio-a845d71e88ce54ab665e90cd4d9a9766d590300556583079f2be3a510cc2672e WatchSource:0}: Error finding container a845d71e88ce54ab665e90cd4d9a9766d590300556583079f2be3a510cc2672e: Status 404 returned error can't find the container with id a845d71e88ce54ab665e90cd4d9a9766d590300556583079f2be3a510cc2672e Jul 08 21:33:04.611624 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.611608 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:04.619797 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.619778 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26355e38_8733_43cf_a4ad_fde077a7d6ca.slice/crio-458aa3434ec550bca1c2fc1bee244732db8ac2217db731eb8d3a32766511b7a9 WatchSource:0}: Error finding container 458aa3434ec550bca1c2fc1bee244732db8ac2217db731eb8d3a32766511b7a9: Status 404 returned error can't find the container with id 458aa3434ec550bca1c2fc1bee244732db8ac2217db731eb8d3a32766511b7a9 Jul 08 21:33:04.627728 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.627706 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9rlpl" Jul 08 21:33:04.634500 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.634477 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" Jul 08 21:33:04.636339 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.636313 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2fd010_44cc_44ce_9813_3c399cf7f0e5.slice/crio-7347bc7cdd4e801eb3eb4dca2372df753164417ebc2e5f6480e05432e4457168 WatchSource:0}: Error finding container 7347bc7cdd4e801eb3eb4dca2372df753164417ebc2e5f6480e05432e4457168: Status 404 returned error can't find the container with id 7347bc7cdd4e801eb3eb4dca2372df753164417ebc2e5f6480e05432e4457168 Jul 08 21:33:04.643180 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.643159 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode026841a_477f_4e0c_87ed_e4e0d160b9d0.slice/crio-02a35b0f7fae03a8b1dcfdfde3af682c09264b571f7d97b65d7eb7b79ddf1d47 WatchSource:0}: Error finding container 02a35b0f7fae03a8b1dcfdfde3af682c09264b571f7d97b65d7eb7b79ddf1d47: Status 404 returned error can't find the container with id 02a35b0f7fae03a8b1dcfdfde3af682c09264b571f7d97b65d7eb7b79ddf1d47 Jul 08 21:33:04.663349 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.663325 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44cx7" Jul 08 21:33:04.671573 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.671551 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6a682f_5056_4a76_bb8e_9cd16d4ff7c6.slice/crio-abad2d7e3117b8d2930859abbb49e3d813675d6232f07e53120b3f2764455ba5 WatchSource:0}: Error finding container abad2d7e3117b8d2930859abbb49e3d813675d6232f07e53120b3f2764455ba5: Status 404 returned error can't find the container with id abad2d7e3117b8d2930859abbb49e3d813675d6232f07e53120b3f2764455ba5 Jul 08 21:33:04.683922 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.683901 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" Jul 08 21:33:04.689838 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.689818 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-792s4" Jul 08 21:33:04.692033 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.692014 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4993f060_dc4a_4eb7_8e3e_1691911e1f12.slice/crio-567ac6a81f4b09db15eef4377a97c865c3b083ac025ec86d3f787bd3f839d23b WatchSource:0}: Error finding container 567ac6a81f4b09db15eef4377a97c865c3b083ac025ec86d3f787bd3f839d23b: Status 404 returned error can't find the container with id 567ac6a81f4b09db15eef4377a97c865c3b083ac025ec86d3f787bd3f839d23b Jul 08 21:33:04.693724 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.693706 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:04.698363 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.698343 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5c4287_d7ea_4953_8883_a7d627071421.slice/crio-7327c7308e4fd42f4f1a04795fc41db63d7d5c3b84afb3955ecc164fd1d75344 WatchSource:0}: Error finding container 7327c7308e4fd42f4f1a04795fc41db63d7d5c3b84afb3955ecc164fd1d75344: Status 404 returned error can't find the container with id 7327c7308e4fd42f4f1a04795fc41db63d7d5c3b84afb3955ecc164fd1d75344 Jul 08 21:33:04.703140 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:04.703117 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e5bf7a_f29e_48f2_98c4_7554baa9c483.slice/crio-d756b21a7bf66b7dfe1c16e358c1cdc0a032c0057d380aa6d0c5044e17ec4f86 WatchSource:0}: Error finding container d756b21a7bf66b7dfe1c16e358c1cdc0a032c0057d380aa6d0c5044e17ec4f86: Status 404 returned error can't find the container with id d756b21a7bf66b7dfe1c16e358c1cdc0a032c0057d380aa6d0c5044e17ec4f86 Jul 08 21:33:04.704853 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.704836 2559 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-vx886_kube-system(87e5bf7a-f29e-48f2-98c4-7554baa9c483): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 08 21:33:04.704903 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.704874 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-vx886" podUID="87e5bf7a-f29e-48f2-98c4-7554baa9c483" Jul 08 21:33:04.873264 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.873168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:04.873264 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.873210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:04.873264 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:04.873248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:04.873513 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.873338 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:04.873513 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.873370 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:04.873513 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.873389 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 21:33:04.873513 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.873405 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 21:33:04.873513 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.873415 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs podName:c83c1b24-4d75-435c-8806-d2e2e1ac0e6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:05.873394981 +0000 UTC m=+2.986389682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs") pod "network-metrics-daemon-rszm5" (UID: "c83c1b24-4d75-435c-8806-d2e2e1ac0e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:04.873513 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.873430 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret podName:58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:05.873424116 +0000 UTC m=+2.986418812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret") pod "global-pull-secret-syncer-wffhf" (UID: "58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d") : object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:04.873513 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.873417 2559 projected.go:196] Error preparing data for projected volume kube-api-access-czcvz for pod openshift-network-diagnostics/network-check-target-k2sg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:04.873513 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:04.873511 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz podName:adce1b77-3f45-41ab-bebf-c46606b14e74 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:05.873497111 +0000 UTC m=+2.986491807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-czcvz" (UniqueName: "kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz") pod "network-check-target-k2sg5" (UID: "adce1b77-3f45-41ab-bebf-c46606b14e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:05.298706 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.298631 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:28:04 +0000 UTC" deadline="2028-04-09 14:45:06.87341347 +0000 UTC" Jul 08 21:33:05.298706 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.298695 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15377h12m1.574722128s" Jul 08 21:33:05.442278 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.441634 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:05.442278 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.441772 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:05.460206 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.459479 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerStarted","Data":"a845d71e88ce54ab665e90cd4d9a9766d590300556583079f2be3a510cc2672e"} Jul 08 21:33:05.486757 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.486712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pbcmq" event={"ID":"031fa896-6c07-4e1c-9044-7ee0a6951a3c","Type":"ContainerStarted","Data":"e9b304b41f679b85fc1326c0f7a222f44de7e4890981bca5a6dd8aba07a9a0bb"} Jul 08 21:33:05.491984 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.491943 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" event={"ID":"bbda490fa50675fa459f3fc992f874a7","Type":"ContainerStarted","Data":"a7ee485457c57973222254bd924e8b642a6a906e662c9e24cb258218e3be9606"} Jul 08 21:33:05.510897 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.510860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vx886" event={"ID":"87e5bf7a-f29e-48f2-98c4-7554baa9c483","Type":"ContainerStarted","Data":"d756b21a7bf66b7dfe1c16e358c1cdc0a032c0057d380aa6d0c5044e17ec4f86"} Jul 08 21:33:05.514353 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.514320 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-vx886" podUID="87e5bf7a-f29e-48f2-98c4-7554baa9c483" Jul 08 21:33:05.518703 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.518669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-792s4" event={"ID":"ea5c4287-d7ea-4953-8883-a7d627071421","Type":"ContainerStarted","Data":"7327c7308e4fd42f4f1a04795fc41db63d7d5c3b84afb3955ecc164fd1d75344"} Jul 08 21:33:05.536940 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.536903 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" event={"ID":"4993f060-dc4a-4eb7-8e3e-1691911e1f12","Type":"ContainerStarted","Data":"567ac6a81f4b09db15eef4377a97c865c3b083ac025ec86d3f787bd3f839d23b"} Jul 08 21:33:05.545379 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.544213 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" event={"ID":"e026841a-477f-4e0c-87ed-e4e0d160b9d0","Type":"ContainerStarted","Data":"02a35b0f7fae03a8b1dcfdfde3af682c09264b571f7d97b65d7eb7b79ddf1d47"} Jul 08 21:33:05.554463 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.554380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9rlpl" event={"ID":"4b2fd010-44cc-44ce-9813-3c399cf7f0e5","Type":"ContainerStarted","Data":"7347bc7cdd4e801eb3eb4dca2372df753164417ebc2e5f6480e05432e4457168"} Jul 08 21:33:05.558145 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.558110 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"458aa3434ec550bca1c2fc1bee244732db8ac2217db731eb8d3a32766511b7a9"} Jul 08 21:33:05.567715 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.567681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" event={"ID":"a635b78dfde69bf143c48d7a0ccb7ef8","Type":"ContainerStarted","Data":"0a6fa5e958d867a24c10952eea260f21c5a090ab82bba0c4d517affb53527c89"} Jul 08 21:33:05.576284 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.576249 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44cx7" event={"ID":"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6","Type":"ContainerStarted","Data":"abad2d7e3117b8d2930859abbb49e3d813675d6232f07e53120b3f2764455ba5"} Jul 08 21:33:05.733034 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.733003 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 21:33:05.882285 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.882212 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:05.882463 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.882304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:05.882463 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:05.882352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:05.882590 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.882529 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 21:33:05.882590 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.882548 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 21:33:05.882590 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.882561 2559 projected.go:196] Error preparing data for projected volume kube-api-access-czcvz for pod openshift-network-diagnostics/network-check-target-k2sg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:05.882735 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.882617 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz podName:adce1b77-3f45-41ab-bebf-c46606b14e74 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:07.882600127 +0000 UTC m=+4.995594824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-czcvz" (UniqueName: "kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz") pod "network-check-target-k2sg5" (UID: "adce1b77-3f45-41ab-bebf-c46606b14e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:05.883021 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.883004 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:05.883097 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.883055 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs podName:c83c1b24-4d75-435c-8806-d2e2e1ac0e6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:07.883040516 +0000 UTC m=+4.996035216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs") pod "network-metrics-daemon-rszm5" (UID: "c83c1b24-4d75-435c-8806-d2e2e1ac0e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:05.883158 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.883124 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:05.883257 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:05.883156 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret podName:58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:07.883145789 +0000 UTC m=+4.996140488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret") pod "global-pull-secret-syncer-wffhf" (UID: "58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d") : object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:06.299734 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:06.299679 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:28:04 +0000 UTC" deadline="2028-03-14 08:25:45.216474621 +0000 UTC" Jul 08 21:33:06.299734 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:06.299733 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14746h52m38.916747116s" Jul 08 21:33:06.438708 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:06.438675 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:06.438885 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:06.438823 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:06.439254 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:06.439231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:06.439362 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:06.439332 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:07.371925 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:07.371702 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 21:33:07.439705 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:07.439655 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:07.439881 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.439785 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:07.902599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:07.902685 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:07.902714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.902845 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.902902 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret podName:58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:11.902885619 +0000 UTC m=+9.015880321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret") pod "global-pull-secret-syncer-wffhf" (UID: "58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d") : object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.903344 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.903366 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.903379 2559 projected.go:196] Error preparing data for projected volume kube-api-access-czcvz for pod openshift-network-diagnostics/network-check-target-k2sg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.903425 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz podName:adce1b77-3f45-41ab-bebf-c46606b14e74 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:11.903411228 +0000 UTC m=+9.016405929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-czcvz" (UniqueName: "kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz") pod "network-check-target-k2sg5" (UID: "adce1b77-3f45-41ab-bebf-c46606b14e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.903483 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:07.903565 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:07.903532 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs podName:c83c1b24-4d75-435c-8806-d2e2e1ac0e6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:11.903505441 +0000 UTC m=+9.016500141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs") pod "network-metrics-daemon-rszm5" (UID: "c83c1b24-4d75-435c-8806-d2e2e1ac0e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:08.439210 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:08.439174 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:08.439747 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:08.439312 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:08.439747 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:08.439579 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:08.439747 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:08.439691 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:09.439417 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:09.439386 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:09.439906 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:09.439603 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:10.438952 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:10.438911 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:10.439132 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:10.439055 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:10.439132 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:10.439107 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:10.439263 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:10.439226 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:11.438574 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:11.438544 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:11.439032 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.438692 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:11.933132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:11.933182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:11.933226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.933295 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.933335 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.933349 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.933361 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs podName:c83c1b24-4d75-435c-8806-d2e2e1ac0e6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.933341684 +0000 UTC m=+17.046336393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs") pod "network-metrics-daemon-rszm5" (UID: "c83c1b24-4d75-435c-8806-d2e2e1ac0e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.933363 2559 projected.go:196] Error preparing data for projected volume kube-api-access-czcvz for pod openshift-network-diagnostics/network-check-target-k2sg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.933400 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz podName:adce1b77-3f45-41ab-bebf-c46606b14e74 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.933389103 +0000 UTC m=+17.046383800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-czcvz" (UniqueName: "kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz") pod "network-check-target-k2sg5" (UID: "adce1b77-3f45-41ab-bebf-c46606b14e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.933412 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:11.933506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:11.933442 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret podName:58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:19.933433376 +0000 UTC m=+17.046428078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret") pod "global-pull-secret-syncer-wffhf" (UID: "58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d") : object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:12.438843 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:12.438348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:12.438843 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:12.438368 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:12.438843 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:12.438484 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:12.438843 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:12.438627 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:13.440333 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:13.439806 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:13.440333 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:13.439947 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:14.438396 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:14.438349 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:14.438605 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:14.438349 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:14.438605 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:14.438489 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:14.438605 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:14.438590 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:15.439602 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:15.439442 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:15.440070 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:15.439608 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:16.439020 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:16.438988 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:16.439167 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:16.438988 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:16.439167 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:16.439104 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:16.439167 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:16.439155 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:17.439173 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:17.439136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:17.439632 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:17.439286 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:18.438739 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:18.438700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:18.438913 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:18.438700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:18.438913 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:18.438870 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:18.439020 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:18.438962 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:19.439002 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:19.438970 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:19.439417 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.439102 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:19.996035 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:19.996002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:19.996035 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:19.996039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:19.996285 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:19.996072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:19.996285 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.996174 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:19.996285 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.996188 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 21:33:19.996285 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.996208 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 21:33:19.996285 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.996221 2559 projected.go:196] Error preparing data for projected volume kube-api-access-czcvz for pod openshift-network-diagnostics/network-check-target-k2sg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:19.996285 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.996174 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:19.996554 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.996251 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs podName:c83c1b24-4d75-435c-8806-d2e2e1ac0e6d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:35.996230523 +0000 UTC m=+33.109225220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs") pod "network-metrics-daemon-rszm5" (UID: "c83c1b24-4d75-435c-8806-d2e2e1ac0e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:19.996554 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.996329 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz podName:adce1b77-3f45-41ab-bebf-c46606b14e74 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:35.996299426 +0000 UTC m=+33.109294133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-czcvz" (UniqueName: "kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz") pod "network-check-target-k2sg5" (UID: "adce1b77-3f45-41ab-bebf-c46606b14e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:19.996554 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:19.996356 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret podName:58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d nodeName:}" failed. No retries permitted until 2026-07-08 21:33:35.996343168 +0000 UTC m=+33.109337865 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret") pod "global-pull-secret-syncer-wffhf" (UID: "58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d") : object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:20.439024 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:20.438982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:20.439505 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:20.439033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:20.439505 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:20.439115 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:20.439505 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:20.439259 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:21.439021 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:21.438985 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:21.439207 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:21.439136 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:22.439251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:22.439218 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:22.439728 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:22.439338 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:22.439728 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:22.439396 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:22.439728 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:22.439493 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:23.439631 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:23.439601 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:23.440086 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:23.439707 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:24.438774 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.438743 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:24.438935 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:24.438882 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:24.439441 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.439289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:24.439441 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:24.439402 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:24.625600 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.625234 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pbcmq" event={"ID":"031fa896-6c07-4e1c-9044-7ee0a6951a3c","Type":"ContainerStarted","Data":"f1d1c8c423e71568049f0c96bd895254a7642da92b1bbbb8f2169ee1cd2190a7"} Jul 08 21:33:24.627495 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.627070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" event={"ID":"bbda490fa50675fa459f3fc992f874a7","Type":"ContainerStarted","Data":"85abc1cd16ac2bd5e9ddc8dd5c91e57687c3c8039277c196de6a5715a43f7ba9"} Jul 08 21:33:24.628916 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.628893 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vx886" event={"ID":"87e5bf7a-f29e-48f2-98c4-7554baa9c483","Type":"ContainerStarted","Data":"885b46ee888ea18ca5096a7f0773bd34ff880b85f65668f23961f10518944d89"} Jul 08 21:33:24.630498 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.630477 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-792s4" event={"ID":"ea5c4287-d7ea-4953-8883-a7d627071421","Type":"ContainerStarted","Data":"d7209c3b3bb9ecfe016fb26fbc8149c0cc4444f379f4069aba9b05b2ff2861cf"} Jul 08 21:33:24.632035 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.632012 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" event={"ID":"4993f060-dc4a-4eb7-8e3e-1691911e1f12","Type":"ContainerStarted","Data":"a817a4173070af13569dc638303eae4b3d1b51709f1901823c02fe00020d6196"} Jul 08 21:33:24.634283 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.634263 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" event={"ID":"e026841a-477f-4e0c-87ed-e4e0d160b9d0","Type":"ContainerStarted","Data":"87f91111f30cd085db14e344d2ebc7701ed34247df6b0ee7b17aff919d537df9"} Jul 08 21:33:24.636436 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.636376 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"f21573cc7cf63c5d52d6e16d2d45c6f0f1c2a9872948c25b265b3faadb51bf20"} Jul 08 21:33:24.637889 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.637869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" event={"ID":"a635b78dfde69bf143c48d7a0ccb7ef8","Type":"ContainerStarted","Data":"612f6ccd4785289ed065d01512cbf3c5a2ef75acad3534bc0ebb71064a68a60c"} Jul 08 21:33:24.641780 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.641445 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44cx7" event={"ID":"dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6","Type":"ContainerStarted","Data":"a8110f2ae4b2a1697d1a5ee9dbd5a58dd9a6b574d144001e3bef0faa06883adc"} Jul 08 21:33:24.646148 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.646092 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pbcmq" podStartSLOduration=2.641729029 podStartE2EDuration="21.646074738s" totalImagesPullingTime="19.004345709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:24.64518299 +0000 UTC m=+21.758177711" watchObservedRunningTime="2026-07-08 21:33:24.646074738 +0000 UTC m=+21.759069457" Jul 08 21:33:24.648487 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.648464 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerStarted","Data":"85aa56f31942b928f5b020dcc6ee234a05bb121f20b23fc5ce37c78ff02d1fa3"} Jul 08 21:33:24.661026 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.660991 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nmrzv" podStartSLOduration=2.791695848 podStartE2EDuration="21.660977568s" totalImagesPullingTime="18.86928172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:24.660978258 +0000 UTC m=+21.773972996" watchObservedRunningTime="2026-07-08 21:33:24.660977568 +0000 UTC m=+21.773972286" Jul 08 21:33:24.693137 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.693098 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-44cx7" podStartSLOduration=2.806025247 podStartE2EDuration="21.693080831s" totalImagesPullingTime="18.887055584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:24.692883118 +0000 UTC m=+21.805877836" watchObservedRunningTime="2026-07-08 21:33:24.693080831 +0000 UTC m=+21.806075549" Jul 08 21:33:24.725437 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.725397 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vx886" podStartSLOduration=2.058415999 podStartE2EDuration="21.725381887s" totalImagesPullingTime="19.666965888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-08 21:33:24.70837545 +0000 UTC m=+21.821370168" watchObservedRunningTime="2026-07-08 21:33:24.725381887 +0000 UTC m=+21.838376605" Jul 08 21:33:24.725574 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.725468 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" podStartSLOduration=20.725464333 podStartE2EDuration="20.725464333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:24.725203607 +0000 UTC m=+21.838198325" watchObservedRunningTime="2026-07-08 21:33:24.725464333 +0000 UTC m=+21.838459050" Jul 08 21:33:24.880071 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.880043 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:24.880602 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:24.880574 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:25.440099 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.439293 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:25.440260 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:25.440202 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:25.651705 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.651671 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9rlpl" event={"ID":"4b2fd010-44cc-44ce-9813-3c399cf7f0e5","Type":"ContainerStarted","Data":"8bcb50ce737dcaae1d440a6b330660a25be8ab1a067763f99774f4085f812252"} Jul 08 21:33:25.654272 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.654255 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:33:25.654558 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.654542 2559 generic.go:356] "Generic (PLEG): container finished" podID="26355e38-8733-43cf-a4ad-fde077a7d6ca" containerID="e50eae0f86364725c93938767af07e346a1f7bae1e70a477e8af18e279406678" exitCode=1 Jul 08 21:33:25.654609 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.654564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"4824f7b02ee72276dd5033bb087abf640eb8802d99e0a0a5dc8692a1e04097d0"} Jul 08 21:33:25.654647 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.654625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"d80bc23232816b35e9427e3a3611aa3ddbb0b4e22a467d837d0cbb0965ed31ed"} Jul 08 21:33:25.654687 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.654660 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"f397621d8fbe16864f3c918f4638819914954817872a538a9e950b2e990649aa"} Jul 08 21:33:25.654724 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.654702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"eaeb08b34cfcedcf7d1f07801e7a7b225df5f4e8adf288a4499ba64b01863ec6"} Jul 08 21:33:25.654764 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.654731 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerDied","Data":"e50eae0f86364725c93938767af07e346a1f7bae1e70a477e8af18e279406678"} Jul 08 21:33:25.658664 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.658381 2559 generic.go:356] "Generic (PLEG): container finished" podID="a635b78dfde69bf143c48d7a0ccb7ef8" containerID="612f6ccd4785289ed065d01512cbf3c5a2ef75acad3534bc0ebb71064a68a60c" exitCode=0 Jul 08 21:33:25.658664 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.658494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" event={"ID":"a635b78dfde69bf143c48d7a0ccb7ef8","Type":"ContainerDied","Data":"612f6ccd4785289ed065d01512cbf3c5a2ef75acad3534bc0ebb71064a68a60c"} Jul 08 21:33:25.660508 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.660488 2559 generic.go:356] "Generic (PLEG): container finished" podID="d9cd29c1-4f21-4d00-b8f8-9ad130e0979f" containerID="85aa56f31942b928f5b020dcc6ee234a05bb121f20b23fc5ce37c78ff02d1fa3" exitCode=0 Jul 08 21:33:25.660644 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.660616 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerDied","Data":"85aa56f31942b928f5b020dcc6ee234a05bb121f20b23fc5ce37c78ff02d1fa3"} Jul 08 21:33:25.660831 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.660812 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:25.661397 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.661377 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vx886" Jul 08 21:33:25.675101 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.675062 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9rlpl" podStartSLOduration=3.752077612 podStartE2EDuration="22.675048141s" totalImagesPullingTime="18.922970529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:25.674395877 +0000 UTC m=+22.787390596" watchObservedRunningTime="2026-07-08 21:33:25.675048141 +0000 UTC m=+22.788042855" Jul 08 21:33:25.710279 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.710234 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-792s4" podStartSLOduration=3.849407905 podStartE2EDuration="22.710217709s" totalImagesPullingTime="18.860809804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:25.7090906 +0000 UTC m=+22.822085318" watchObservedRunningTime="2026-07-08 21:33:25.710217709 +0000 UTC m=+22.823212431" Jul 08 21:33:25.942326 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:25.942296 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 21:33:26.339413 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:26.339289 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T21:33:25.942315227Z","UUID":"29dc61a2-7407-4bad-8a9d-25b0affb2efa","Handler":null,"Name":"","Endpoint":""} Jul 08 21:33:26.341038 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:26.341009 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 21:33:26.341169 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:26.341054 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 21:33:26.438419 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:26.438389 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:26.438605 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:26.438385 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:26.438605 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:26.438536 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:26.438721 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:26.438598 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:26.664945 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:26.664857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" event={"ID":"e026841a-477f-4e0c-87ed-e4e0d160b9d0","Type":"ContainerStarted","Data":"54ff61898051c2be4e1a0b00b75d4a28c5348c5b14a000b5bad1fa0e90c7b87f"} Jul 08 21:33:26.666941 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:26.666910 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" event={"ID":"a635b78dfde69bf143c48d7a0ccb7ef8","Type":"ContainerStarted","Data":"2ab9b6d7bb6d556c95b0f5574d356d2062cdcc268ad0e21b93b5c15183565d0b"} Jul 08 21:33:26.684554 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:26.684486 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" podStartSLOduration=22.684466204 podStartE2EDuration="22.684466204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:26.684265245 +0000 UTC m=+23.797259985" watchObservedRunningTime="2026-07-08 21:33:26.684466204 +0000 UTC m=+23.797460925" Jul 08 21:33:27.439396 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:27.439360 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:27.439650 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:27.439504 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:27.671606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:27.671571 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" event={"ID":"e026841a-477f-4e0c-87ed-e4e0d160b9d0","Type":"ContainerStarted","Data":"7150cfb9cfc7c55cee301714d13c5c41ccd7ee4c6e33da5bd70393cd881fe50e"} Jul 08 21:33:28.439387 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:28.439185 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:28.439600 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:28.439226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:28.439600 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:28.439491 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:28.439721 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:28.439609 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:28.677648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:28.677624 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:33:28.678127 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:28.678089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"c730336eb1e6820cb6109507723d28be1f9b6486e978ab146c01189be7c8e423"} Jul 08 21:33:29.439229 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:29.439200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:29.439419 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:29.439318 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:30.439332 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.439134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:30.440049 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.439164 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:30.440049 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:30.439411 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:30.440049 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:30.439553 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:30.686439 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.686417 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:33:30.686812 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.686783 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"8152a38b7900dd9f50d4f1c685a12d6dc072e5e1f8abbffd9890d328bc0059af"} Jul 08 21:33:30.687022 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.686999 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:30.687233 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.687216 2559 scope.go:117] "RemoveContainer" containerID="e50eae0f86364725c93938767af07e346a1f7bae1e70a477e8af18e279406678" Jul 08 21:33:30.688648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.688623 2559 generic.go:356] "Generic (PLEG): container finished" podID="d9cd29c1-4f21-4d00-b8f8-9ad130e0979f" containerID="6e3aa47af2fd3872e9db9a82a97f5d33c3e41f6cc003c15191b41f755a91421d" exitCode=0 Jul 08 21:33:30.688748 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.688660 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerDied","Data":"6e3aa47af2fd3872e9db9a82a97f5d33c3e41f6cc003c15191b41f755a91421d"} Jul 08 21:33:30.702780 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.702762 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:30.713892 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:30.713853 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mxb46" podStartSLOduration=10.972579557 podStartE2EDuration="27.713840343s" totalImagesPullingTime="16.741260786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:27.693481889 +0000 UTC m=+24.806476607" watchObservedRunningTime="2026-07-08 21:33:30.713840343 +0000 UTC m=+27.826835083" Jul 08 21:33:31.438906 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:31.438869 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:31.439118 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:31.439021 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:31.694140 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:31.694078 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:33:31.694560 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:31.694415 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" event={"ID":"26355e38-8733-43cf-a4ad-fde077a7d6ca","Type":"ContainerStarted","Data":"1ec08081a613fee9a9228f81eeec7a6e64ff30f8b31a143574864bbe34d16c76"} Jul 08 21:33:31.694622 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:31.694591 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:31.694672 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:31.694651 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:31.709856 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:31.709825 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:33:31.722641 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:31.722599 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" podStartSLOduration=8.946868883 podStartE2EDuration="28.72258564s" totalImagesPullingTime="19.775716757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:31.721808891 +0000 UTC m=+28.834803609" watchObservedRunningTime="2026-07-08 21:33:31.72258564 +0000 UTC m=+28.835580358" Jul 08 21:33:32.439144 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:32.439118 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:32.439295 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:32.439151 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:32.439295 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:32.439221 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:32.439374 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:32.439339 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:32.698922 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:32.698833 2559 generic.go:356] "Generic (PLEG): container finished" podID="d9cd29c1-4f21-4d00-b8f8-9ad130e0979f" containerID="27f9dc998b1ea5cfcf18b6bd92326c2a68ba036eaffa50e6e7719b64224cab7a" exitCode=0 Jul 08 21:33:32.698922 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:32.698895 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerDied","Data":"27f9dc998b1ea5cfcf18b6bd92326c2a68ba036eaffa50e6e7719b64224cab7a"} Jul 08 21:33:33.439530 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:33.439492 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:33.439709 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:33.439612 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:34.438469 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:34.438433 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:34.438872 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:34.438553 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:34.438872 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:34.438592 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:34.438872 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:34.438674 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:34.706052 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:34.705969 2559 generic.go:356] "Generic (PLEG): container finished" podID="d9cd29c1-4f21-4d00-b8f8-9ad130e0979f" containerID="551c14e3ab7514444789db7fa37cd2c418b6b23d9cbef4850af11e0777d59880" exitCode=0 Jul 08 21:33:34.706052 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:34.706011 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerDied","Data":"551c14e3ab7514444789db7fa37cd2c418b6b23d9cbef4850af11e0777d59880"} Jul 08 21:33:35.438937 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:35.438909 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:35.439296 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:35.439019 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:36.015642 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:36.015597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:36.015861 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:36.015656 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:36.015861 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:36.015701 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:36.015861 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.015769 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:36.015861 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.015818 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 21:33:36.015861 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.015834 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 21:33:36.015861 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.015832 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:36.015861 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.015847 2559 projected.go:196] Error preparing data for projected volume kube-api-access-czcvz for pod openshift-network-diagnostics/network-check-target-k2sg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:36.015861 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.015856 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs podName:c83c1b24-4d75-435c-8806-d2e2e1ac0e6d nodeName:}" failed. No retries permitted until 2026-07-08 21:34:08.015833285 +0000 UTC m=+65.128827986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs") pod "network-metrics-daemon-rszm5" (UID: "c83c1b24-4d75-435c-8806-d2e2e1ac0e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 21:33:36.016223 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.015890 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret podName:58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d nodeName:}" failed. No retries permitted until 2026-07-08 21:34:08.01587379 +0000 UTC m=+65.128868501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret") pod "global-pull-secret-syncer-wffhf" (UID: "58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d") : object "kube-system"/"original-pull-secret" not registered Jul 08 21:33:36.016223 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.015909 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz podName:adce1b77-3f45-41ab-bebf-c46606b14e74 nodeName:}" failed. No retries permitted until 2026-07-08 21:34:08.015899792 +0000 UTC m=+65.128894495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-czcvz" (UniqueName: "kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz") pod "network-check-target-k2sg5" (UID: "adce1b77-3f45-41ab-bebf-c46606b14e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 21:33:36.439078 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:36.439050 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:36.439506 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:36.439050 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:36.439506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.439167 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:36.439506 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:36.439242 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:37.438680 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:37.438624 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:37.438893 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:37.438776 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:38.439213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:38.439169 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:38.439718 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:38.439174 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:38.439718 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:38.439317 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:38.439718 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:38.439401 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:39.438479 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:39.438447 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:39.438681 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:39.438578 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:39.723739 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:39.723656 2559 generic.go:356] "Generic (PLEG): container finished" podID="d9cd29c1-4f21-4d00-b8f8-9ad130e0979f" containerID="a651aafb9b8696f893c56bad7b551634ecb2e66c8fc7a0423c0168a5a98c7f32" exitCode=0 Jul 08 21:33:39.723739 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:39.723703 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerDied","Data":"a651aafb9b8696f893c56bad7b551634ecb2e66c8fc7a0423c0168a5a98c7f32"} Jul 08 21:33:40.438758 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:40.438728 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:40.438967 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:40.438846 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:40.438967 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:40.438889 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:40.439082 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:40.438969 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:40.729011 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:40.728934 2559 generic.go:356] "Generic (PLEG): container finished" podID="d9cd29c1-4f21-4d00-b8f8-9ad130e0979f" containerID="dff12828a9cfb0e6b93dd703b96fcd0e67525069e59f75da229c24b9ef352a08" exitCode=0 Jul 08 21:33:40.729011 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:40.728977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerDied","Data":"dff12828a9cfb0e6b93dd703b96fcd0e67525069e59f75da229c24b9ef352a08"} Jul 08 21:33:41.438925 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:41.438892 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:41.439078 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:41.439013 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:41.734613 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:41.734534 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9fng" event={"ID":"d9cd29c1-4f21-4d00-b8f8-9ad130e0979f","Type":"ContainerStarted","Data":"f99ff1782ff5bb2f88e13d9afdce79d769f11d9a178d3d5ab36504b47e26123a"} Jul 08 21:33:42.438872 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:42.438842 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:42.439035 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:42.438842 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:42.439035 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:42.438948 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:42.439035 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:42.439009 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:43.439486 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:43.439316 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:43.439863 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:43.439566 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:44.438775 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:44.438745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:44.438941 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:44.438745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:44.438941 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:44.438846 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:44.438941 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:44.438908 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:45.439063 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:45.439028 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:45.439417 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:45.439145 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:46.438921 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:46.438886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:46.439061 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:46.438886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:46.439061 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:46.438990 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:46.439373 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:46.439063 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:47.438936 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:47.438901 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:47.439220 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:47.439038 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:48.439032 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:48.438996 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:48.439223 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:48.438996 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:48.439223 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:48.439103 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:48.439223 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:48.439183 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:49.439007 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:49.438980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:49.439259 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:49.439225 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:50.287563 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:50.287487 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f9fng" podStartSLOduration=17.017676082 podStartE2EDuration="47.287467144s" totalImagesPullingTime="30.269791062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:41.761903085 +0000 UTC m=+38.874897802" watchObservedRunningTime="2026-07-08 21:33:50.287467144 +0000 UTC m=+47.400461859" Jul 08 21:33:50.288507 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:50.288487 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k2sg5"] Jul 08 21:33:50.288646 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:50.288595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:50.288695 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:50.288679 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:50.291280 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:50.291256 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wffhf"] Jul 08 21:33:50.291405 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:50.291340 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:50.291468 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:50.291434 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:50.292112 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:50.292087 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rszm5"] Jul 08 21:33:50.292339 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:50.292318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:50.292455 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:50.292428 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:51.439317 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:51.439280 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:51.439948 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:51.439390 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:52.438861 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:52.438827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:52.439042 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:52.438935 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rszm5" podUID="c83c1b24-4d75-435c-8806-d2e2e1ac0e6d" Jul 08 21:33:52.439042 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:52.438998 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:52.439168 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:52.439111 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wffhf" podUID="58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d" Jul 08 21:33:53.439597 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.439563 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:53.440075 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:33:53.439649 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2sg5" podUID="adce1b77-3f45-41ab-bebf-c46606b14e74" Jul 08 21:33:53.792640 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.792616 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeReady" Jul 08 21:33:53.792789 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.792748 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 21:33:53.832572 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.832539 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75d8f6dd6c-4rlj2"] Jul 08 21:33:53.838878 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.838859 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.841481 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.841457 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 21:33:53.841627 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.841609 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 21:33:53.842002 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.841986 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 21:33:53.844309 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.844293 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-psx4j\"" Jul 08 21:33:53.844764 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.844746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0484dff-4386-4817-9f95-8b85b78a3002-ca-trust-extracted\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.844831 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.844775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0484dff-4386-4817-9f95-8b85b78a3002-trusted-ca\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.844831 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.844797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0484dff-4386-4817-9f95-8b85b78a3002-image-registry-private-configuration\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.844831 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.844813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0484dff-4386-4817-9f95-8b85b78a3002-registry-certificates\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.844929 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.844914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-registry-tls\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.845028 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.844995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-bound-sa-token\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.845085 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.845051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jc2\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-kube-api-access-98jc2\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.845137 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.845080 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0484dff-4386-4817-9f95-8b85b78a3002-installation-pull-secrets\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.846325 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.846297 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 21:33:53.851054 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.851033 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fml67"] Jul 08 21:33:53.855022 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.855008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fml67" Jul 08 21:33:53.857265 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.857242 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75d8f6dd6c-4rlj2"] Jul 08 21:33:53.857871 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.857853 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gtbqt"] Jul 08 21:33:53.858321 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.858299 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 21:33:53.858417 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.858354 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 21:33:53.858487 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.858358 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 21:33:53.858487 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.858453 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kngpn\"" Jul 08 21:33:53.863285 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.863268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:53.866735 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.866717 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wfpxn\"" Jul 08 21:33:53.867119 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.867102 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 21:33:53.867427 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.867389 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 21:33:53.867584 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.867566 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fml67"] Jul 08 21:33:53.872817 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.872795 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gtbqt"] Jul 08 21:33:53.944763 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.944730 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nrrlw"] Jul 08 21:33:53.945313 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0484dff-4386-4817-9f95-8b85b78a3002-installation-pull-secrets\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.945368 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945346 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4fhn\" (UniqueName: \"kubernetes.io/projected/f449634b-9f5a-42c0-9db6-9ac933d753ae-kube-api-access-r4fhn\") pod \"ingress-canary-fml67\" (UID: \"f449634b-9f5a-42c0-9db6-9ac933d753ae\") " pod="openshift-ingress-canary/ingress-canary-fml67" Jul 08 21:33:53.945403 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0484dff-4386-4817-9f95-8b85b78a3002-ca-trust-extracted\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.945449 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0484dff-4386-4817-9f95-8b85b78a3002-trusted-ca\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.945484 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-config-volume\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:53.945553 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0484dff-4386-4817-9f95-8b85b78a3002-image-registry-private-configuration\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.945639 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945620 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0484dff-4386-4817-9f95-8b85b78a3002-registry-certificates\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.945685 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f449634b-9f5a-42c0-9db6-9ac933d753ae-cert\") pod \"ingress-canary-fml67\" (UID: \"f449634b-9f5a-42c0-9db6-9ac933d753ae\") " pod="openshift-ingress-canary/ingress-canary-fml67" Jul 08 21:33:53.945735 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-registry-tls\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.945776 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945735 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0484dff-4386-4817-9f95-8b85b78a3002-ca-trust-extracted\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.945849 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-metrics-tls\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:53.945884 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945861 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-tmp-dir\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:53.945916 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hfng\" (UniqueName: \"kubernetes.io/projected/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-kube-api-access-2hfng\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:53.945948 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945922 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-bound-sa-token\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.945979 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.945947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98jc2\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-kube-api-access-98jc2\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.949531 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.949401 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-registry-tls\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.949640 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.949434 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0484dff-4386-4817-9f95-8b85b78a3002-image-registry-private-configuration\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.949640 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.949451 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0484dff-4386-4817-9f95-8b85b78a3002-installation-pull-secrets\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.953749 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.953723 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0484dff-4386-4817-9f95-8b85b78a3002-registry-certificates\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.953905 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.953881 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0484dff-4386-4817-9f95-8b85b78a3002-trusted-ca\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.954713 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.954694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jc2\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-kube-api-access-98jc2\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.954801 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.954785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0484dff-4386-4817-9f95-8b85b78a3002-bound-sa-token\") pod \"image-registry-75d8f6dd6c-4rlj2\" (UID: \"a0484dff-4386-4817-9f95-8b85b78a3002\") " pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:53.955322 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.955303 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:53.957733 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.957712 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nrrlw"] Jul 08 21:33:53.959495 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.959413 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 21:33:53.959495 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.959434 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 21:33:53.959656 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.959583 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-65cm9\"" Jul 08 21:33:53.959656 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.959596 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 21:33:53.959775 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:53.959722 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 21:33:54.046215 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-metrics-tls\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.046215 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046217 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-tmp-dir\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.046456 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hfng\" (UniqueName: \"kubernetes.io/projected/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-kube-api-access-2hfng\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.046456 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046262 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.046456 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4vr\" (UniqueName: \"kubernetes.io/projected/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-kube-api-access-5k4vr\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.046456 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-crio-socket\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.046456 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4fhn\" (UniqueName: \"kubernetes.io/projected/f449634b-9f5a-42c0-9db6-9ac933d753ae-kube-api-access-r4fhn\") pod \"ingress-canary-fml67\" (UID: \"f449634b-9f5a-42c0-9db6-9ac933d753ae\") " pod="openshift-ingress-canary/ingress-canary-fml67" Jul 08 21:33:54.046722 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-data-volume\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.046722 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.046722 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-config-volume\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.046722 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046580 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-tmp-dir\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.046722 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.046666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f449634b-9f5a-42c0-9db6-9ac933d753ae-cert\") pod \"ingress-canary-fml67\" (UID: \"f449634b-9f5a-42c0-9db6-9ac933d753ae\") " pod="openshift-ingress-canary/ingress-canary-fml67" Jul 08 21:33:54.047047 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.047029 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-config-volume\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.048677 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.048657 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-metrics-tls\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.048985 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.048967 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f449634b-9f5a-42c0-9db6-9ac933d753ae-cert\") pod \"ingress-canary-fml67\" (UID: \"f449634b-9f5a-42c0-9db6-9ac933d753ae\") " pod="openshift-ingress-canary/ingress-canary-fml67" Jul 08 21:33:54.055103 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.055084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4fhn\" (UniqueName: \"kubernetes.io/projected/f449634b-9f5a-42c0-9db6-9ac933d753ae-kube-api-access-r4fhn\") pod \"ingress-canary-fml67\" (UID: \"f449634b-9f5a-42c0-9db6-9ac933d753ae\") " pod="openshift-ingress-canary/ingress-canary-fml67" Jul 08 21:33:54.055399 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.055372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hfng\" (UniqueName: \"kubernetes.io/projected/8d464437-f8bc-4a0e-aaf0-4cacfc0033d5-kube-api-access-2hfng\") pod \"dns-default-gtbqt\" (UID: \"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5\") " pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.147219 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.147185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-data-volume\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.147219 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.147220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.147447 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.147286 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.147447 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.147305 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4vr\" (UniqueName: \"kubernetes.io/projected/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-kube-api-access-5k4vr\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.147447 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.147323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-crio-socket\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.147620 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.147558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-crio-socket\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.147620 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.147597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-data-volume\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.147832 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.147804 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.149647 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.149631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.151598 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.151584 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:54.154633 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.154608 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4vr\" (UniqueName: \"kubernetes.io/projected/5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72-kube-api-access-5k4vr\") pod \"insights-runtime-extractor-nrrlw\" (UID: \"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72\") " pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.163528 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.163504 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fml67" Jul 08 21:33:54.171600 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.171587 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:54.268933 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.268640 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nrrlw" Jul 08 21:33:54.374993 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.374773 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gtbqt"] Jul 08 21:33:54.377358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.377329 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fml67"] Jul 08 21:33:54.382011 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:54.381984 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d464437_f8bc_4a0e_aaf0_4cacfc0033d5.slice/crio-b779ad18ccde11a1f26455a3af2c25e63958379e8253ce2b220fd91e168d42ed WatchSource:0}: Error finding container b779ad18ccde11a1f26455a3af2c25e63958379e8253ce2b220fd91e168d42ed: Status 404 returned error can't find the container with id b779ad18ccde11a1f26455a3af2c25e63958379e8253ce2b220fd91e168d42ed Jul 08 21:33:54.382221 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:54.382201 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf449634b_9f5a_42c0_9db6_9ac933d753ae.slice/crio-750b5de2a2935194bb1d99d128327ba1f8a2cd39ac1010db87402a6030301a50 WatchSource:0}: Error finding container 750b5de2a2935194bb1d99d128327ba1f8a2cd39ac1010db87402a6030301a50: Status 404 returned error can't find the container with id 750b5de2a2935194bb1d99d128327ba1f8a2cd39ac1010db87402a6030301a50 Jul 08 21:33:54.390427 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.390402 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75d8f6dd6c-4rlj2"] Jul 08 21:33:54.401219 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:54.401164 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0484dff_4386_4817_9f95_8b85b78a3002.slice/crio-97ff1265215fabf55e0ee10c6577b23398bcc64c6330045ab298c9edca1653e3 WatchSource:0}: Error finding container 97ff1265215fabf55e0ee10c6577b23398bcc64c6330045ab298c9edca1653e3: Status 404 returned error can't find the container with id 97ff1265215fabf55e0ee10c6577b23398bcc64c6330045ab298c9edca1653e3 Jul 08 21:33:54.439081 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.439021 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:33:54.439277 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.439259 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:33:54.440511 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.440486 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nrrlw"] Jul 08 21:33:54.441445 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.441413 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 21:33:54.441445 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.441440 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4v6kt\"" Jul 08 21:33:54.441631 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.441440 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 21:33:54.445236 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:33:54.445215 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbeb8e4_fe15_4baa_b0b5_397c3b91bc72.slice/crio-e4f80f344d833d00604c5cd285c0b0ec44bc84f88713b1b685b1d1216f01f62a WatchSource:0}: Error finding container e4f80f344d833d00604c5cd285c0b0ec44bc84f88713b1b685b1d1216f01f62a: Status 404 returned error can't find the container with id e4f80f344d833d00604c5cd285c0b0ec44bc84f88713b1b685b1d1216f01f62a Jul 08 21:33:54.764257 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.764215 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrrlw" event={"ID":"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72","Type":"ContainerStarted","Data":"e4f80f344d833d00604c5cd285c0b0ec44bc84f88713b1b685b1d1216f01f62a"} Jul 08 21:33:54.765291 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.765260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtbqt" event={"ID":"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5","Type":"ContainerStarted","Data":"b779ad18ccde11a1f26455a3af2c25e63958379e8253ce2b220fd91e168d42ed"} Jul 08 21:33:54.766958 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.766923 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" event={"ID":"a0484dff-4386-4817-9f95-8b85b78a3002","Type":"ContainerStarted","Data":"2ad1bad97646af8a8e3810c704efe5d5d66d2d28b1427573e5e291a8e8c76522"} Jul 08 21:33:54.767039 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.766978 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" event={"ID":"a0484dff-4386-4817-9f95-8b85b78a3002","Type":"ContainerStarted","Data":"97ff1265215fabf55e0ee10c6577b23398bcc64c6330045ab298c9edca1653e3"} Jul 08 21:33:54.767039 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.767011 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:33:54.768091 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.768068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fml67" event={"ID":"f449634b-9f5a-42c0-9db6-9ac933d753ae","Type":"ContainerStarted","Data":"750b5de2a2935194bb1d99d128327ba1f8a2cd39ac1010db87402a6030301a50"} Jul 08 21:33:54.786358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:54.786316 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" podStartSLOduration=6.786302797 podStartE2EDuration="6.786302797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:54.785175193 +0000 UTC m=+51.898169911" watchObservedRunningTime="2026-07-08 21:33:54.786302797 +0000 UTC m=+51.899297505" Jul 08 21:33:55.441423 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:55.440681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:33:55.444792 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:55.444591 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 21:33:55.446093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:55.445718 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wsbgf\"" Jul 08 21:33:55.446093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:55.445943 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 21:33:59.786311 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:59.786263 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtbqt" event={"ID":"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5","Type":"ContainerStarted","Data":"e949fa8f14ebdcf34c3d0aecafe96c8c9fb20e5f3b48ad08bc52c9a042a4f7b1"} Jul 08 21:33:59.786893 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:59.786325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gtbqt" event={"ID":"8d464437-f8bc-4a0e-aaf0-4cacfc0033d5","Type":"ContainerStarted","Data":"905bf37ee7d02276b2eedc9cc54b616b1ee9e227f9142f9517421962ccf0dd32"} Jul 08 21:33:59.786893 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:59.786354 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gtbqt" Jul 08 21:33:59.787730 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:59.787700 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fml67" event={"ID":"f449634b-9f5a-42c0-9db6-9ac933d753ae","Type":"ContainerStarted","Data":"89c4d50c6377c334915c1a64153da1279d058be38b7a22382fbf2ca7202b950b"} Jul 08 21:33:59.789042 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:59.789014 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrrlw" event={"ID":"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72","Type":"ContainerStarted","Data":"03c9832c09a8808f6981d7795ba464ba36b1116f0caad7111bbb33a5cd1ce019"} Jul 08 21:33:59.805757 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:59.805719 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gtbqt" podStartSLOduration=1.7614902909999999 podStartE2EDuration="6.80570666s" totalImagesPullingTime="5.044216369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:59.804850454 +0000 UTC m=+56.917845174" watchObservedRunningTime="2026-07-08 21:33:59.80570666 +0000 UTC m=+56.918701752" Jul 08 21:33:59.820510 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:33:59.820470 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fml67" podStartSLOduration=1.7761165540000001 podStartE2EDuration="6.82043235s" totalImagesPullingTime="5.044315796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:59.819676646 +0000 UTC m=+56.932671364" watchObservedRunningTime="2026-07-08 21:33:59.82043235 +0000 UTC m=+56.933427084" Jul 08 21:34:00.795858 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:00.795797 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrrlw" event={"ID":"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72","Type":"ContainerStarted","Data":"cae6c46024a553a95d9d889e423cbd1e2fc23ab22ad37bf411251e2ed50e72b7"} Jul 08 21:34:02.803646 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:02.803607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrrlw" event={"ID":"5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72","Type":"ContainerStarted","Data":"168907cd1eaed5c0b18a7fb313f98e4d073868d5221ea13c0d6bd6bb133f1f14"} Jul 08 21:34:02.822061 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:02.822016 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nrrlw" podStartSLOduration=1.703732933 podStartE2EDuration="9.822000878s" totalImagesPullingTime="8.118267945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:02.82092897 +0000 UTC m=+59.933923690" watchObservedRunningTime="2026-07-08 21:34:02.822000878 +0000 UTC m=+59.934995578" Jul 08 21:34:03.715244 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:03.715212 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v76jx" Jul 08 21:34:06.138477 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.138439 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n"] Jul 08 21:34:06.141012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.140994 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-749x4"] Jul 08 21:34:06.141135 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.141116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.142713 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.142695 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.143690 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.143663 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 21:34:06.143975 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.143962 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 21:34:06.144044 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.143997 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 21:34:06.144100 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.144002 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 21:34:06.146964 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.146939 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 21:34:06.146964 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.146956 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 21:34:06.147124 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.147030 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 21:34:06.147124 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.147042 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-f4dvg\"" Jul 08 21:34:06.147124 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.147028 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 21:34:06.147335 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.147321 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 21:34:06.147335 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.147329 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6w4g6\"" Jul 08 21:34:06.154013 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.153988 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n"] Jul 08 21:34:06.231112 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-accelerators-collector-config\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231304 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-wtmp\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231304 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231304 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-textfile\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231304 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zndsw\" (UniqueName: \"kubernetes.io/projected/4e533842-22eb-41c2-85b2-0e87649c2f69-kube-api-access-zndsw\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-root\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/05f7fe17-7a6f-433f-be87-121eaa21fe06-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f7fe17-7a6f-433f-be87-121eaa21fe06-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5z5p\" (UniqueName: \"kubernetes.io/projected/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-api-access-j5z5p\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231558 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-sys\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-tls\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e533842-22eb-41c2-85b2-0e87649c2f69-metrics-client-ca\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.231923 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.231671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.332950 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.332917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-textfile\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.332950 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.332956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zndsw\" (UniqueName: \"kubernetes.io/projected/4e533842-22eb-41c2-85b2-0e87649c2f69-kube-api-access-zndsw\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.332984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-root\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/05f7fe17-7a6f-433f-be87-121eaa21fe06-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.333178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.333178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f7fe17-7a6f-433f-be87-121eaa21fe06-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.333178 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333142 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-root\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333178 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:34:06.333143 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5z5p\" (UniqueName: \"kubernetes.io/projected/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-api-access-j5z5p\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333215 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-sys\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:34:06.333250 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-tls podName:05f7fe17-7a6f-433f-be87-121eaa21fe06 nodeName:}" failed. No retries permitted until 2026-07-08 21:34:06.833227532 +0000 UTC m=+63.946222241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-jlv9n" (UID: "05f7fe17-7a6f-433f-be87-121eaa21fe06") : secret "kube-state-metrics-tls" not found Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333262 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-sys\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-tls\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e533842-22eb-41c2-85b2-0e87649c2f69-metrics-client-ca\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333424 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-accelerators-collector-config\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333444 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/05f7fe17-7a6f-433f-be87-121eaa21fe06-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.333978 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-wtmp\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333978 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333978 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333514 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-textfile\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.333978 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f7fe17-7a6f-433f-be87-121eaa21fe06-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.334149 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.333991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-wtmp\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.334149 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.334039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-accelerators-collector-config\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.334208 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.334192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.334280 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.334263 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e533842-22eb-41c2-85b2-0e87649c2f69-metrics-client-ca\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.337116 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.337087 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.337264 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.337134 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-tls\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.337264 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.337164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e533842-22eb-41c2-85b2-0e87649c2f69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.341323 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.341293 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5z5p\" (UniqueName: \"kubernetes.io/projected/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-api-access-j5z5p\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.341428 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.341413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zndsw\" (UniqueName: \"kubernetes.io/projected/4e533842-22eb-41c2-85b2-0e87649c2f69-kube-api-access-zndsw\") pod \"node-exporter-749x4\" (UID: \"4e533842-22eb-41c2-85b2-0e87649c2f69\") " pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.456280 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.456247 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-749x4" Jul 08 21:34:06.465350 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:34:06.465320 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e533842_22eb_41c2_85b2_0e87649c2f69.slice/crio-d1cd93f27af4be8d6e4d32316ed0754f9c6650423e04d6792b5b61ecc005e8ed WatchSource:0}: Error finding container d1cd93f27af4be8d6e4d32316ed0754f9c6650423e04d6792b5b61ecc005e8ed: Status 404 returned error can't find the container with id d1cd93f27af4be8d6e4d32316ed0754f9c6650423e04d6792b5b61ecc005e8ed Jul 08 21:34:06.817348 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.817261 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-749x4" event={"ID":"4e533842-22eb-41c2-85b2-0e87649c2f69","Type":"ContainerStarted","Data":"d1cd93f27af4be8d6e4d32316ed0754f9c6650423e04d6792b5b61ecc005e8ed"} Jul 08 21:34:06.837644 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.837613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:06.839929 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:06.839879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05f7fe17-7a6f-433f-be87-121eaa21fe06-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jlv9n\" (UID: \"05f7fe17-7a6f-433f-be87-121eaa21fe06\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:07.051387 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:07.051350 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" Jul 08 21:34:07.187425 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:07.187394 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n"] Jul 08 21:34:07.190812 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:34:07.190783 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f7fe17_7a6f_433f_be87_121eaa21fe06.slice/crio-e735a529525a1c2745f66cdf08d08a1ed532a665c70e66da443943073175e19a WatchSource:0}: Error finding container e735a529525a1c2745f66cdf08d08a1ed532a665c70e66da443943073175e19a: Status 404 returned error can't find the container with id e735a529525a1c2745f66cdf08d08a1ed532a665c70e66da443943073175e19a Jul 08 21:34:07.822407 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:07.822365 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" event={"ID":"05f7fe17-7a6f-433f-be87-121eaa21fe06","Type":"ContainerStarted","Data":"e735a529525a1c2745f66cdf08d08a1ed532a665c70e66da443943073175e19a"} Jul 08 21:34:07.824419 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:07.824387 2559 generic.go:356] "Generic (PLEG): container finished" podID="4e533842-22eb-41c2-85b2-0e87649c2f69" containerID="b2450e8dd9af7e17ea9bf2755ca30a13fa39ee75ec6b1cbdce319fc7e3be6c22" exitCode=0 Jul 08 21:34:07.824574 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:07.824427 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-749x4" event={"ID":"4e533842-22eb-41c2-85b2-0e87649c2f69","Type":"ContainerDied","Data":"b2450e8dd9af7e17ea9bf2755ca30a13fa39ee75ec6b1cbdce319fc7e3be6c22"} Jul 08 21:34:08.046532 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.046476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:34:08.046721 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.046589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:34:08.046721 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.046628 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:34:08.049202 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.049120 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 21:34:08.049347 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.049262 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 21:34:08.049347 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.049305 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 21:34:08.059759 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.059736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d-original-pull-secret\") pod \"global-pull-secret-syncer-wffhf\" (UID: \"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d\") " pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:34:08.059901 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.059786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c83c1b24-4d75-435c-8806-d2e2e1ac0e6d-metrics-certs\") pod \"network-metrics-daemon-rszm5\" (UID: \"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d\") " pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:34:08.059901 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.059894 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 21:34:08.070308 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.070281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czcvz\" (UniqueName: \"kubernetes.io/projected/adce1b77-3f45-41ab-bebf-c46606b14e74-kube-api-access-czcvz\") pod \"network-check-target-k2sg5\" (UID: \"adce1b77-3f45-41ab-bebf-c46606b14e74\") " pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:34:08.202315 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.202278 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c9b649967-9tnhd"] Jul 08 21:34:08.204836 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.204817 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.208837 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.208814 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xlgk5\"" Jul 08 21:34:08.208837 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.208830 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 21:34:08.209329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.209248 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 21:34:08.209329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.209250 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 21:34:08.209484 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.209336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-988thd1m29mu2\"" Jul 08 21:34:08.209484 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.209426 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 21:34:08.209484 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.209427 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 21:34:08.218465 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.218407 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c9b649967-9tnhd"] Jul 08 21:34:08.247296 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.247267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tgmw\" (UniqueName: \"kubernetes.io/projected/0bb8699e-8209-4c49-9529-c3b3e69453de-kube-api-access-8tgmw\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.247481 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.247308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.247481 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.247341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.247481 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.247389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.247481 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.247417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.247481 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.247441 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-tls\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.247681 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.247503 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bb8699e-8209-4c49-9529-c3b3e69453de-metrics-client-ca\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.247681 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.247553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-grpc-tls\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.266000 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.265959 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4v6kt\"" Jul 08 21:34:08.268177 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.268142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wffhf" Jul 08 21:34:08.274287 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.274266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rszm5" Jul 08 21:34:08.348088 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bb8699e-8209-4c49-9529-c3b3e69453de-metrics-client-ca\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.348265 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-grpc-tls\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.348265 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tgmw\" (UniqueName: \"kubernetes.io/projected/0bb8699e-8209-4c49-9529-c3b3e69453de-kube-api-access-8tgmw\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.348265 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.348265 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.349058 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.349058 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.349058 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-tls\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.349058 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.348877 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bb8699e-8209-4c49-9529-c3b3e69453de-metrics-client-ca\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.351344 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.351295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.351702 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.351678 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.351832 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.351810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-grpc-tls\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.351923 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.351850 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.352179 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.352156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.352657 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.352639 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bb8699e-8209-4c49-9529-c3b3e69453de-secret-thanos-querier-tls\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.359856 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.359808 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wsbgf\"" Jul 08 21:34:08.360013 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.359992 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tgmw\" (UniqueName: \"kubernetes.io/projected/0bb8699e-8209-4c49-9529-c3b3e69453de-kube-api-access-8tgmw\") pod \"thanos-querier-5c9b649967-9tnhd\" (UID: \"0bb8699e-8209-4c49-9529-c3b3e69453de\") " pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.368014 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.367982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:34:08.516128 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.516042 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:08.720774 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.720303 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c9b649967-9tnhd"] Jul 08 21:34:08.727139 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:34:08.727103 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb8699e_8209_4c49_9529_c3b3e69453de.slice/crio-97c8d2656b6240221b320d16e6f2480333545beab57ec57e0be9e485368d783d WatchSource:0}: Error finding container 97c8d2656b6240221b320d16e6f2480333545beab57ec57e0be9e485368d783d: Status 404 returned error can't find the container with id 97c8d2656b6240221b320d16e6f2480333545beab57ec57e0be9e485368d783d Jul 08 21:34:08.748816 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.746931 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rszm5"] Jul 08 21:34:08.748816 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.748103 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k2sg5"] Jul 08 21:34:08.754305 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:34:08.754275 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83c1b24_4d75_435c_8806_d2e2e1ac0e6d.slice/crio-a2d181611f8755e94ad0e2ff501a85ba82d733b469f00000f158e48d811743bb WatchSource:0}: Error finding container a2d181611f8755e94ad0e2ff501a85ba82d733b469f00000f158e48d811743bb: Status 404 returned error can't find the container with id a2d181611f8755e94ad0e2ff501a85ba82d733b469f00000f158e48d811743bb Jul 08 21:34:08.755980 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:34:08.755951 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadce1b77_3f45_41ab_bebf_c46606b14e74.slice/crio-e4626ca7d329ef45a96dd1d319599f73679f4233d9ecef947ba01931ec5ed524 WatchSource:0}: Error finding container e4626ca7d329ef45a96dd1d319599f73679f4233d9ecef947ba01931ec5ed524: Status 404 returned error can't find the container with id e4626ca7d329ef45a96dd1d319599f73679f4233d9ecef947ba01931ec5ed524 Jul 08 21:34:08.774838 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.774781 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wffhf"] Jul 08 21:34:08.783994 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:34:08.783960 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e2dcf6_3fd0_48a4_b8de_38f0781c9f8d.slice/crio-551270c8b95d6853de60a67d9d4cd4ef96e40026dda19ed14c4a021b6030271d WatchSource:0}: Error finding container 551270c8b95d6853de60a67d9d4cd4ef96e40026dda19ed14c4a021b6030271d: Status 404 returned error can't find the container with id 551270c8b95d6853de60a67d9d4cd4ef96e40026dda19ed14c4a021b6030271d Jul 08 21:34:08.831196 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.831149 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" event={"ID":"05f7fe17-7a6f-433f-be87-121eaa21fe06","Type":"ContainerStarted","Data":"054e661fcad24ce9de9932ff5c99bf561ae0555928a83822cb9adb5c0a007438"} Jul 08 21:34:08.831411 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.831217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" event={"ID":"05f7fe17-7a6f-433f-be87-121eaa21fe06","Type":"ContainerStarted","Data":"bbd4688147ef0cd742e8af7c560b85a430285e438fa71c41d2f97a7feb0704e0"} Jul 08 21:34:08.831411 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.831242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" event={"ID":"05f7fe17-7a6f-433f-be87-121eaa21fe06","Type":"ContainerStarted","Data":"f473dc7cab28457d5117080a28a8f88d6ebd1836a9ed872dd57f14b5bfc834e8"} Jul 08 21:34:08.832963 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.832928 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" event={"ID":"0bb8699e-8209-4c49-9529-c3b3e69453de","Type":"ContainerStarted","Data":"97c8d2656b6240221b320d16e6f2480333545beab57ec57e0be9e485368d783d"} Jul 08 21:34:08.834301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.834271 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k2sg5" event={"ID":"adce1b77-3f45-41ab-bebf-c46606b14e74","Type":"ContainerStarted","Data":"e4626ca7d329ef45a96dd1d319599f73679f4233d9ecef947ba01931ec5ed524"} Jul 08 21:34:08.836971 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.836943 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-749x4" event={"ID":"4e533842-22eb-41c2-85b2-0e87649c2f69","Type":"ContainerStarted","Data":"a51c46b83dd190d5936edf1b983ad9407ef2131d2cb237e0abee31593ae48ea0"} Jul 08 21:34:08.837086 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.836985 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-749x4" event={"ID":"4e533842-22eb-41c2-85b2-0e87649c2f69","Type":"ContainerStarted","Data":"a42191966e9b79f0aba6af8ab47045b3f5fd37aaff92a6f013fc0e205080d43d"} Jul 08 21:34:08.838301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.838273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wffhf" event={"ID":"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d","Type":"ContainerStarted","Data":"551270c8b95d6853de60a67d9d4cd4ef96e40026dda19ed14c4a021b6030271d"} Jul 08 21:34:08.839299 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.839279 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rszm5" event={"ID":"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d","Type":"ContainerStarted","Data":"a2d181611f8755e94ad0e2ff501a85ba82d733b469f00000f158e48d811743bb"} Jul 08 21:34:08.850277 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.850226 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jlv9n" podStartSLOduration=1.4769033249999999 podStartE2EDuration="2.850207682s" totalImagesPullingTime="1.373304357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:08.849332331 +0000 UTC m=+65.962327050" watchObservedRunningTime="2026-07-08 21:34:08.850207682 +0000 UTC m=+65.963202443" Jul 08 21:34:08.871084 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:08.868995 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-749x4" podStartSLOduration=1.858661447 podStartE2EDuration="2.868973826s" totalImagesPullingTime="946.555775ms" totalInitContainerRuntime="63.756604ms" isStatefulPod=true podCreationTimestamp="2026-07-08 21:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:08.866813773 +0000 UTC m=+65.979808505" watchObservedRunningTime="2026-07-08 21:34:08.868973826 +0000 UTC m=+65.981968545" Jul 08 21:34:09.798988 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:09.798954 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gtbqt" Jul 08 21:34:10.853326 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:10.853283 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rszm5" event={"ID":"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d","Type":"ContainerStarted","Data":"42757c656dfb4941faac46cec50a5db1646ef9256314c461a38ab6716e0991b9"} Jul 08 21:34:10.853793 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:10.853346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rszm5" event={"ID":"c83c1b24-4d75-435c-8806-d2e2e1ac0e6d","Type":"ContainerStarted","Data":"1357a8cca82182bcf2c8414b09b95b6537e759da39c46e867849726b12fd0335"} Jul 08 21:34:10.877493 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:10.877437 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rszm5" podStartSLOduration=66.794872243 podStartE2EDuration="1m7.877423027s" totalImagesPullingTime="1.082550784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:10.876401391 +0000 UTC m=+67.989396121" watchObservedRunningTime="2026-07-08 21:34:10.877423027 +0000 UTC m=+67.990417745" Jul 08 21:34:11.320998 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.320965 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b69769dc4-hzrss"] Jul 08 21:34:11.337675 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.337642 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.338810 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.338783 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b69769dc4-hzrss"] Jul 08 21:34:11.340699 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.340676 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 21:34:11.340938 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.340919 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 21:34:11.341882 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.341856 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 21:34:11.342099 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.342075 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 21:34:11.342287 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.342274 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 21:34:11.342499 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.342467 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b8zn5\"" Jul 08 21:34:11.342499 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.342479 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 21:34:11.342785 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.342768 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 21:34:11.347649 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.347047 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 21:34:11.376963 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.376920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-serving-cert\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.376963 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.376965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-service-ca\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.377194 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.376997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-oauth-serving-cert\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.377194 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.377028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gntdk\" (UniqueName: \"kubernetes.io/projected/5ab2a681-7c57-477f-8d65-77cd5d1845d9-kube-api-access-gntdk\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.377194 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.377107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-trusted-ca-bundle\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.377194 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.377167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-oauth-config\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.377194 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.377192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-config\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.477892 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.477847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-trusted-ca-bundle\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.478094 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.477911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-oauth-config\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.478094 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.477943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-config\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.478094 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.477975 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-serving-cert\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.478094 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.478016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-service-ca\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.478094 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.478041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-oauth-serving-cert\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.478094 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.478069 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gntdk\" (UniqueName: \"kubernetes.io/projected/5ab2a681-7c57-477f-8d65-77cd5d1845d9-kube-api-access-gntdk\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.478938 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.478887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-trusted-ca-bundle\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.479063 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.478951 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-config\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.479127 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.479097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-service-ca\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.479190 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.479097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-oauth-serving-cert\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.481506 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.481283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-serving-cert\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.481506 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.481407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-oauth-config\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.487774 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.487730 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gntdk\" (UniqueName: \"kubernetes.io/projected/5ab2a681-7c57-477f-8d65-77cd5d1845d9-kube-api-access-gntdk\") pod \"console-7b69769dc4-hzrss\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:11.651287 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:11.651200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:14.004642 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.004614 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b69769dc4-hzrss"] Jul 08 21:34:14.008344 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:34:14.008316 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab2a681_7c57_477f_8d65_77cd5d1845d9.slice/crio-8f3f19f607fdaa468821f25986409a8b86edc23f2ecc5d786b2fe6b023edbf68 WatchSource:0}: Error finding container 8f3f19f607fdaa468821f25986409a8b86edc23f2ecc5d786b2fe6b023edbf68: Status 404 returned error can't find the container with id 8f3f19f607fdaa468821f25986409a8b86edc23f2ecc5d786b2fe6b023edbf68 Jul 08 21:34:14.873701 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.873667 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" event={"ID":"0bb8699e-8209-4c49-9529-c3b3e69453de","Type":"ContainerStarted","Data":"772fe300932f6cd4e0bd8cce635e95738c542d9ed33b044cee3bb1bcf18caef6"} Jul 08 21:34:14.873839 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.873735 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" event={"ID":"0bb8699e-8209-4c49-9529-c3b3e69453de","Type":"ContainerStarted","Data":"530ad771f3165d6749483914a6fea3a9e6272817ea04e36fe91eb09186a6dce2"} Jul 08 21:34:14.873839 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.873776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" event={"ID":"0bb8699e-8209-4c49-9529-c3b3e69453de","Type":"ContainerStarted","Data":"f802c08e7654bb50176609408ff0a9cc3de9be673e8c347410bd40cc5ac7f048"} Jul 08 21:34:14.873839 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.873820 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" event={"ID":"0bb8699e-8209-4c49-9529-c3b3e69453de","Type":"ContainerStarted","Data":"0897e4a6e6f76ab2cc5f12189a5448395c2b9b998d760a6f29e87508e6b4a0f8"} Jul 08 21:34:14.875385 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.875359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k2sg5" event={"ID":"adce1b77-3f45-41ab-bebf-c46606b14e74","Type":"ContainerStarted","Data":"a6ae706cdcbf88bcae1b8c6b5db461d6eb579f856a4fa01884c1e91e6cdee3bd"} Jul 08 21:34:14.875504 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.875478 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:34:14.877882 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.877095 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b69769dc4-hzrss" event={"ID":"5ab2a681-7c57-477f-8d65-77cd5d1845d9","Type":"ContainerStarted","Data":"8f3f19f607fdaa468821f25986409a8b86edc23f2ecc5d786b2fe6b023edbf68"} Jul 08 21:34:14.883986 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.883738 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wffhf" event={"ID":"58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d","Type":"ContainerStarted","Data":"71d79f53ee737e419fa390ebd4808542f19fd2240143a0cc670db6a0f29d6710"} Jul 08 21:34:14.891971 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.891916 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k2sg5" podStartSLOduration=66.788823167 podStartE2EDuration="1m11.891901843s" totalImagesPullingTime="5.103078676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:14.891703103 +0000 UTC m=+72.004697823" watchObservedRunningTime="2026-07-08 21:34:14.891901843 +0000 UTC m=+72.004896561" Jul 08 21:34:14.908713 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:14.908663 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wffhf" podStartSLOduration=66.82697074 podStartE2EDuration="1m11.90864277s" totalImagesPullingTime="5.08167203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:14.907414663 +0000 UTC m=+72.020409383" watchObservedRunningTime="2026-07-08 21:34:14.90864277 +0000 UTC m=+72.021637487" Jul 08 21:34:15.778589 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:15.778560 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75d8f6dd6c-4rlj2" Jul 08 21:34:15.891593 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:15.891555 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" event={"ID":"0bb8699e-8209-4c49-9529-c3b3e69453de","Type":"ContainerStarted","Data":"8b1926e66179bdf6ab85e7637eef57f68e0a91932345e2a8487ebf9cd4365ae4"} Jul 08 21:34:15.891780 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:15.891641 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" event={"ID":"0bb8699e-8209-4c49-9529-c3b3e69453de","Type":"ContainerStarted","Data":"57b709da5cc2be653385e5cd049620ad09b1ca9c401cb7385fda8f36d5ffaac6"} Jul 08 21:34:15.916706 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:15.916659 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" podStartSLOduration=2.128170835 podStartE2EDuration="7.91664298s" totalImagesPullingTime="5.788472145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:15.914843917 +0000 UTC m=+73.027838655" watchObservedRunningTime="2026-07-08 21:34:15.91664298 +0000 UTC m=+73.029637697" Jul 08 21:34:16.895941 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:16.895904 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:17.900883 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:17.900843 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b69769dc4-hzrss" event={"ID":"5ab2a681-7c57-477f-8d65-77cd5d1845d9","Type":"ContainerStarted","Data":"a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338"} Jul 08 21:34:17.922230 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:17.922180 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b69769dc4-hzrss" podStartSLOduration=3.9447536149999998 podStartE2EDuration="6.922163411s" totalImagesPullingTime="2.977409796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:17.92038766 +0000 UTC m=+75.033382379" watchObservedRunningTime="2026-07-08 21:34:17.922163411 +0000 UTC m=+75.035158128" Jul 08 21:34:21.652069 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:21.652030 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:21.652466 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:21.652095 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:21.656975 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:21.656951 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:21.922995 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:21.922914 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:34:22.907679 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:22.907650 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c9b649967-9tnhd" Jul 08 21:34:45.894209 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:34:45.894080 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k2sg5" Jul 08 21:35:30.429245 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.429203 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-797b4545c6-h4wlc"] Jul 08 21:35:30.432664 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.432643 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.435184 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.435147 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 21:35:30.435329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.435190 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 21:35:30.435329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.435219 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 21:35:30.435329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.435190 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-x26kr\"" Jul 08 21:35:30.435329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.435191 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 21:35:30.435531 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.435504 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 21:35:30.441137 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.441107 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 21:35:30.445887 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.445866 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-797b4545c6-h4wlc"] Jul 08 21:35:30.483368 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.483337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-telemeter-client-tls\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.483578 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.483385 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-metrics-client-ca\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.483578 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.483409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-serving-certs-ca-bundle\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.483578 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.483436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-federate-client-tls\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.483578 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.483482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-secret-telemeter-client\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.483578 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.483500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.483772 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.483589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.483772 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.483622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-925z5\" (UniqueName: \"kubernetes.io/projected/ed81dc10-a835-4632-8c31-8fbeee61151f-kube-api-access-925z5\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.584672 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.584631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-metrics-client-ca\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.584827 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.584679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-serving-certs-ca-bundle\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.584871 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.584821 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-federate-client-tls\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.584916 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.584881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-secret-telemeter-client\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.584949 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.584914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.584982 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.584953 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.585029 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.584984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-925z5\" (UniqueName: \"kubernetes.io/projected/ed81dc10-a835-4632-8c31-8fbeee61151f-kube-api-access-925z5\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.585029 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.585011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-telemeter-client-tls\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.585433 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.585404 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-serving-certs-ca-bundle\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.585576 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.585479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-metrics-client-ca\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.586128 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.586102 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed81dc10-a835-4632-8c31-8fbeee61151f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.587354 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.587328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-federate-client-tls\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.587443 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.587414 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.587729 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.587711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-telemeter-client-tls\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.587841 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.587820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ed81dc10-a835-4632-8c31-8fbeee61151f-secret-telemeter-client\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.592823 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.592803 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-925z5\" (UniqueName: \"kubernetes.io/projected/ed81dc10-a835-4632-8c31-8fbeee61151f-kube-api-access-925z5\") pod \"telemeter-client-797b4545c6-h4wlc\" (UID: \"ed81dc10-a835-4632-8c31-8fbeee61151f\") " pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.748418 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.748380 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" Jul 08 21:35:30.883540 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:30.883426 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-797b4545c6-h4wlc"] Jul 08 21:35:30.886140 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:35:30.886113 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded81dc10_a835_4632_8c31_8fbeee61151f.slice/crio-e29bca2fa03410363af8e488a43c47b9a1d11d18f463c4bfec4a17d68af4ea4e WatchSource:0}: Error finding container e29bca2fa03410363af8e488a43c47b9a1d11d18f463c4bfec4a17d68af4ea4e: Status 404 returned error can't find the container with id e29bca2fa03410363af8e488a43c47b9a1d11d18f463c4bfec4a17d68af4ea4e Jul 08 21:35:31.154264 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:31.154171 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" event={"ID":"ed81dc10-a835-4632-8c31-8fbeee61151f","Type":"ContainerStarted","Data":"e29bca2fa03410363af8e488a43c47b9a1d11d18f463c4bfec4a17d68af4ea4e"} Jul 08 21:35:33.162906 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:33.162871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" event={"ID":"ed81dc10-a835-4632-8c31-8fbeee61151f","Type":"ContainerStarted","Data":"b8af984d32b78a46a14f5192cf04f68a3d5395350a4be8b43be2cf9b721710e0"} Jul 08 21:35:34.168268 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:34.168241 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" event={"ID":"ed81dc10-a835-4632-8c31-8fbeee61151f","Type":"ContainerStarted","Data":"6a8c5acaa9d1ac6a1b63ae21833bdb13058c6e3fa60a6e4546f7aa7ad61e7e4a"} Jul 08 21:35:35.173204 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:35.173162 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" event={"ID":"ed81dc10-a835-4632-8c31-8fbeee61151f","Type":"ContainerStarted","Data":"87c58ac332dcfad99f77131100ab0dcaf04a7ed9f5eb4e74007060639e8b5a86"} Jul 08 21:35:35.196382 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:35.196328 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-797b4545c6-h4wlc" podStartSLOduration=2.079965631 podStartE2EDuration="5.196311763s" totalImagesPullingTime="3.116346132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:35:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:35:35.19460388 +0000 UTC m=+152.307598600" watchObservedRunningTime="2026-07-08 21:35:35.196311763 +0000 UTC m=+152.309306481" Jul 08 21:35:35.922999 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:35.922968 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d79fff59c-p7mrw"] Jul 08 21:35:35.925861 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:35.925844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:35.942384 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:35.942361 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d79fff59c-p7mrw"] Jul 08 21:35:36.034773 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.034734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-service-ca\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.034773 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.034773 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-oauth-serving-cert\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.035008 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.034797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-serving-cert\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.035008 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.034814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-trusted-ca-bundle\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.035008 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.034852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-console-config\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.035008 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.034925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-oauth-config\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.035008 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.034973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4jj7\" (UniqueName: \"kubernetes.io/projected/5919cae7-2f40-4768-81fc-56ed32085076-kube-api-access-n4jj7\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.135465 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.135417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-console-config\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.135465 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.135467 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-oauth-config\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.135658 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.135510 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jj7\" (UniqueName: \"kubernetes.io/projected/5919cae7-2f40-4768-81fc-56ed32085076-kube-api-access-n4jj7\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.135658 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.135568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-service-ca\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.135856 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.135827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-oauth-serving-cert\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.135910 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.135895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-serving-cert\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.135950 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.135932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-trusted-ca-bundle\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.136266 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.136242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-service-ca\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.136365 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.136246 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-console-config\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.136491 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.136463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-oauth-serving-cert\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.136665 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.136647 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-trusted-ca-bundle\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.138093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.138073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-oauth-config\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.138169 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.138144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-serving-cert\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.145268 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.145248 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jj7\" (UniqueName: \"kubernetes.io/projected/5919cae7-2f40-4768-81fc-56ed32085076-kube-api-access-n4jj7\") pod \"console-d79fff59c-p7mrw\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.234956 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.234931 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:36.365049 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:36.365017 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d79fff59c-p7mrw"] Jul 08 21:35:36.368358 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:35:36.368325 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5919cae7_2f40_4768_81fc_56ed32085076.slice/crio-beed953621ca9c923c36cf5e47dc0b836941138b7993089c9bedf221f8d19dd7 WatchSource:0}: Error finding container beed953621ca9c923c36cf5e47dc0b836941138b7993089c9bedf221f8d19dd7: Status 404 returned error can't find the container with id beed953621ca9c923c36cf5e47dc0b836941138b7993089c9bedf221f8d19dd7 Jul 08 21:35:37.182316 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:37.182285 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d79fff59c-p7mrw" event={"ID":"5919cae7-2f40-4768-81fc-56ed32085076","Type":"ContainerStarted","Data":"12310b85627d9eccd0ee35c4538e2b4c26befd3acf6d092f4aa6add3e3c61c51"} Jul 08 21:35:37.182479 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:37.182333 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d79fff59c-p7mrw" event={"ID":"5919cae7-2f40-4768-81fc-56ed32085076","Type":"ContainerStarted","Data":"beed953621ca9c923c36cf5e47dc0b836941138b7993089c9bedf221f8d19dd7"} Jul 08 21:35:37.199606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:37.199559 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d79fff59c-p7mrw" podStartSLOduration=2.199543782 podStartE2EDuration="2.199543782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:35:37.198656304 +0000 UTC m=+154.311651023" watchObservedRunningTime="2026-07-08 21:35:37.199543782 +0000 UTC m=+154.312538496" Jul 08 21:35:41.087081 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.087039 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d79fff59c-p7mrw"] Jul 08 21:35:41.112863 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.112831 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f674f7df9-6tws6"] Jul 08 21:35:41.116079 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.116059 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.125476 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.125454 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f674f7df9-6tws6"] Jul 08 21:35:41.178569 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.178507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-trusted-ca-bundle\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.178569 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.178569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-oauth-config\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.178783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.178586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-oauth-serving-cert\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.178783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.178676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-serving-cert\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.178783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.178722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-config\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.178880 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.178810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-service-ca\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.178880 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.178853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmjn2\" (UniqueName: \"kubernetes.io/projected/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-kube-api-access-wmjn2\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.279352 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.279314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-serving-cert\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.279352 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.279361 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-config\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.279626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.279403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-service-ca\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.279626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.279433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmjn2\" (UniqueName: \"kubernetes.io/projected/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-kube-api-access-wmjn2\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.279626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.279454 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-trusted-ca-bundle\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.279626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.279480 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-oauth-config\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.279626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.279505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-oauth-serving-cert\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.280335 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.280309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-service-ca\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.280436 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.280334 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-oauth-serving-cert\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.280436 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.280375 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-config\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.280436 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.280422 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-trusted-ca-bundle\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.282036 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.282002 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-serving-cert\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.282147 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.282073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-console-oauth-config\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.288096 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.288067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmjn2\" (UniqueName: \"kubernetes.io/projected/6cb7bbec-2a1c-44ee-85b5-aa72fff159a2-kube-api-access-wmjn2\") pod \"console-7f674f7df9-6tws6\" (UID: \"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2\") " pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.425609 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.425491 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:41.551642 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:41.551611 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f674f7df9-6tws6"] Jul 08 21:35:41.554715 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:35:41.554686 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb7bbec_2a1c_44ee_85b5_aa72fff159a2.slice/crio-5cf7c5c1076eb3041e36538279be64ba820e2b5b2d957fe9f4065e037c3a4f93 WatchSource:0}: Error finding container 5cf7c5c1076eb3041e36538279be64ba820e2b5b2d957fe9f4065e037c3a4f93: Status 404 returned error can't find the container with id 5cf7c5c1076eb3041e36538279be64ba820e2b5b2d957fe9f4065e037c3a4f93 Jul 08 21:35:42.202150 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:42.202114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f674f7df9-6tws6" event={"ID":"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2","Type":"ContainerStarted","Data":"1e8e7b2d08eb240cb563ff7663dddcf63126c546d3a30ab090f32a8d67c4afa2"} Jul 08 21:35:42.202614 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:42.202191 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f674f7df9-6tws6" event={"ID":"6cb7bbec-2a1c-44ee-85b5-aa72fff159a2","Type":"ContainerStarted","Data":"5cf7c5c1076eb3041e36538279be64ba820e2b5b2d957fe9f4065e037c3a4f93"} Jul 08 21:35:42.218754 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:42.218704 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f674f7df9-6tws6" podStartSLOduration=1.2186877489999999 podStartE2EDuration="1.218687749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:35:42.218326519 +0000 UTC m=+159.331321241" watchObservedRunningTime="2026-07-08 21:35:42.218687749 +0000 UTC m=+159.331682497" Jul 08 21:35:46.235294 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:46.235244 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:35:51.425923 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:51.425884 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:51.426418 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:51.425989 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:51.430616 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:51.430586 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:52.239941 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:52.239915 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f674f7df9-6tws6" Jul 08 21:35:52.285207 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:35:52.285178 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b69769dc4-hzrss"] Jul 08 21:36:06.106900 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.106861 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d79fff59c-p7mrw" podUID="5919cae7-2f40-4768-81fc-56ed32085076" containerName="console" containerID="cri-o://12310b85627d9eccd0ee35c4538e2b4c26befd3acf6d092f4aa6add3e3c61c51" gracePeriod=15 Jul 08 21:36:06.290881 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.290852 2559 generic.go:356] "Generic (PLEG): container finished" podID="5919cae7-2f40-4768-81fc-56ed32085076" containerID="12310b85627d9eccd0ee35c4538e2b4c26befd3acf6d092f4aa6add3e3c61c51" exitCode=0 Jul 08 21:36:06.291024 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.290919 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d79fff59c-p7mrw" event={"ID":"5919cae7-2f40-4768-81fc-56ed32085076","Type":"ContainerDied","Data":"12310b85627d9eccd0ee35c4538e2b4c26befd3acf6d092f4aa6add3e3c61c51"} Jul 08 21:36:06.343469 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.343448 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:36:06.390752 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.390682 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-trusted-ca-bundle\") pod \"5919cae7-2f40-4768-81fc-56ed32085076\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " Jul 08 21:36:06.390752 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.390716 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-service-ca\") pod \"5919cae7-2f40-4768-81fc-56ed32085076\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " Jul 08 21:36:06.390752 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.390739 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-oauth-config\") pod \"5919cae7-2f40-4768-81fc-56ed32085076\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " Jul 08 21:36:06.391000 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.390766 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-oauth-serving-cert\") pod \"5919cae7-2f40-4768-81fc-56ed32085076\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " Jul 08 21:36:06.391000 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.390905 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-console-config\") pod \"5919cae7-2f40-4768-81fc-56ed32085076\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " Jul 08 21:36:06.391000 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.390953 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4jj7\" (UniqueName: \"kubernetes.io/projected/5919cae7-2f40-4768-81fc-56ed32085076-kube-api-access-n4jj7\") pod \"5919cae7-2f40-4768-81fc-56ed32085076\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " Jul 08 21:36:06.391000 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.390975 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-serving-cert\") pod \"5919cae7-2f40-4768-81fc-56ed32085076\" (UID: \"5919cae7-2f40-4768-81fc-56ed32085076\") " Jul 08 21:36:06.391212 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.391157 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-service-ca" (OuterVolumeSpecName: "service-ca") pod "5919cae7-2f40-4768-81fc-56ed32085076" (UID: "5919cae7-2f40-4768-81fc-56ed32085076"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:36:06.391318 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.391219 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5919cae7-2f40-4768-81fc-56ed32085076" (UID: "5919cae7-2f40-4768-81fc-56ed32085076"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:36:06.391318 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.391287 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-console-config" (OuterVolumeSpecName: "console-config") pod "5919cae7-2f40-4768-81fc-56ed32085076" (UID: "5919cae7-2f40-4768-81fc-56ed32085076"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:36:06.391443 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.391424 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5919cae7-2f40-4768-81fc-56ed32085076" (UID: "5919cae7-2f40-4768-81fc-56ed32085076"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:36:06.393090 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.393065 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5919cae7-2f40-4768-81fc-56ed32085076-kube-api-access-n4jj7" (OuterVolumeSpecName: "kube-api-access-n4jj7") pod "5919cae7-2f40-4768-81fc-56ed32085076" (UID: "5919cae7-2f40-4768-81fc-56ed32085076"). InnerVolumeSpecName "kube-api-access-n4jj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:36:06.393090 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.393078 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5919cae7-2f40-4768-81fc-56ed32085076" (UID: "5919cae7-2f40-4768-81fc-56ed32085076"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 21:36:06.393235 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.393088 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5919cae7-2f40-4768-81fc-56ed32085076" (UID: "5919cae7-2f40-4768-81fc-56ed32085076"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 21:36:06.492001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.491963 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-oauth-serving-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:06.492001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.491995 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-console-config\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:06.492001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.492004 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4jj7\" (UniqueName: \"kubernetes.io/projected/5919cae7-2f40-4768-81fc-56ed32085076-kube-api-access-n4jj7\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:06.492217 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.492013 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-serving-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:06.492217 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.492022 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-trusted-ca-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:06.492217 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.492030 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5919cae7-2f40-4768-81fc-56ed32085076-service-ca\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:06.492217 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:06.492037 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5919cae7-2f40-4768-81fc-56ed32085076-console-oauth-config\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:07.295961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:07.295934 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d79fff59c-p7mrw" Jul 08 21:36:07.295961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:07.295939 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d79fff59c-p7mrw" event={"ID":"5919cae7-2f40-4768-81fc-56ed32085076","Type":"ContainerDied","Data":"beed953621ca9c923c36cf5e47dc0b836941138b7993089c9bedf221f8d19dd7"} Jul 08 21:36:07.296512 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:07.296027 2559 scope.go:117] "RemoveContainer" containerID="12310b85627d9eccd0ee35c4538e2b4c26befd3acf6d092f4aa6add3e3c61c51" Jul 08 21:36:07.316675 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:07.316653 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d79fff59c-p7mrw"] Jul 08 21:36:07.320641 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:07.320619 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d79fff59c-p7mrw"] Jul 08 21:36:07.442877 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:07.442849 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5919cae7-2f40-4768-81fc-56ed32085076" path="/var/lib/kubelet/pods/5919cae7-2f40-4768-81fc-56ed32085076/volumes" Jul 08 21:36:17.305893 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.305853 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b69769dc4-hzrss" podUID="5ab2a681-7c57-477f-8d65-77cd5d1845d9" containerName="console" containerID="cri-o://a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338" gracePeriod=15 Jul 08 21:36:17.552262 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.552238 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:36:17.682904 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.682878 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-config\") pod \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " Jul 08 21:36:17.683093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.682923 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-oauth-serving-cert\") pod \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " Jul 08 21:36:17.683093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.682941 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-oauth-config\") pod \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " Jul 08 21:36:17.683093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.682970 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gntdk\" (UniqueName: \"kubernetes.io/projected/5ab2a681-7c57-477f-8d65-77cd5d1845d9-kube-api-access-gntdk\") pod \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " Jul 08 21:36:17.683093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.682992 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-trusted-ca-bundle\") pod \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " Jul 08 21:36:17.683093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.683029 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-serving-cert\") pod \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " Jul 08 21:36:17.683326 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.683096 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-service-ca\") pod \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\" (UID: \"5ab2a681-7c57-477f-8d65-77cd5d1845d9\") " Jul 08 21:36:17.683380 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.683333 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-config" (OuterVolumeSpecName: "console-config") pod "5ab2a681-7c57-477f-8d65-77cd5d1845d9" (UID: "5ab2a681-7c57-477f-8d65-77cd5d1845d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:36:17.683485 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.683379 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ab2a681-7c57-477f-8d65-77cd5d1845d9" (UID: "5ab2a681-7c57-477f-8d65-77cd5d1845d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:36:17.683571 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.683548 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ab2a681-7c57-477f-8d65-77cd5d1845d9" (UID: "5ab2a681-7c57-477f-8d65-77cd5d1845d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:36:17.683668 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.683648 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ab2a681-7c57-477f-8d65-77cd5d1845d9" (UID: "5ab2a681-7c57-477f-8d65-77cd5d1845d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:36:17.685150 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.685128 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ab2a681-7c57-477f-8d65-77cd5d1845d9" (UID: "5ab2a681-7c57-477f-8d65-77cd5d1845d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 21:36:17.685666 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.685641 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ab2a681-7c57-477f-8d65-77cd5d1845d9" (UID: "5ab2a681-7c57-477f-8d65-77cd5d1845d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 21:36:17.685752 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.685726 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab2a681-7c57-477f-8d65-77cd5d1845d9-kube-api-access-gntdk" (OuterVolumeSpecName: "kube-api-access-gntdk") pod "5ab2a681-7c57-477f-8d65-77cd5d1845d9" (UID: "5ab2a681-7c57-477f-8d65-77cd5d1845d9"). InnerVolumeSpecName "kube-api-access-gntdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:36:17.784606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.784574 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-oauth-serving-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:17.784606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.784608 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-oauth-config\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:17.784792 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.784623 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gntdk\" (UniqueName: \"kubernetes.io/projected/5ab2a681-7c57-477f-8d65-77cd5d1845d9-kube-api-access-gntdk\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:17.784792 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.784637 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-trusted-ca-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:17.784792 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.784650 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-serving-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:17.784792 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.784687 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-service-ca\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:17.784792 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:17.784700 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ab2a681-7c57-477f-8d65-77cd5d1845d9-console-config\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:18.335099 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.335070 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ab2a681-7c57-477f-8d65-77cd5d1845d9" containerID="a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338" exitCode=0 Jul 08 21:36:18.335605 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.335115 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b69769dc4-hzrss" Jul 08 21:36:18.335605 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.335117 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b69769dc4-hzrss" event={"ID":"5ab2a681-7c57-477f-8d65-77cd5d1845d9","Type":"ContainerDied","Data":"a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338"} Jul 08 21:36:18.335605 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.335157 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b69769dc4-hzrss" event={"ID":"5ab2a681-7c57-477f-8d65-77cd5d1845d9","Type":"ContainerDied","Data":"8f3f19f607fdaa468821f25986409a8b86edc23f2ecc5d786b2fe6b023edbf68"} Jul 08 21:36:18.335605 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.335177 2559 scope.go:117] "RemoveContainer" containerID="a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338" Jul 08 21:36:18.344063 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.344045 2559 scope.go:117] "RemoveContainer" containerID="a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338" Jul 08 21:36:18.344341 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:36:18.344320 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338\": container with ID starting with a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338 not found: ID does not exist" containerID="a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338" Jul 08 21:36:18.344407 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.344349 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338"} err="failed to get container status \"a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338\": rpc error: code = NotFound desc = could not find container \"a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338\": container with ID starting with a712289c6c8f75dbaa863c34b5b0bf426f80430cbb1f86a64ae79c2d8cd28338 not found: ID does not exist" Jul 08 21:36:18.356529 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.356493 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b69769dc4-hzrss"] Jul 08 21:36:18.360888 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:18.360862 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b69769dc4-hzrss"] Jul 08 21:36:19.442905 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:19.442869 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ab2a681-7c57-477f-8d65-77cd5d1845d9" path="/var/lib/kubelet/pods/5ab2a681-7c57-477f-8d65-77cd5d1845d9/volumes" Jul 08 21:36:30.509442 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.509407 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm"] Jul 08 21:36:30.509894 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.509692 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ab2a681-7c57-477f-8d65-77cd5d1845d9" containerName="console" Jul 08 21:36:30.509894 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.509704 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ab2a681-7c57-477f-8d65-77cd5d1845d9" containerName="console" Jul 08 21:36:30.509894 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.509713 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5919cae7-2f40-4768-81fc-56ed32085076" containerName="console" Jul 08 21:36:30.509894 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.509718 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5919cae7-2f40-4768-81fc-56ed32085076" containerName="console" Jul 08 21:36:30.509894 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.509761 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5919cae7-2f40-4768-81fc-56ed32085076" containerName="console" Jul 08 21:36:30.509894 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.509770 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ab2a681-7c57-477f-8d65-77cd5d1845d9" containerName="console" Jul 08 21:36:30.512677 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.512659 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.515013 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.514993 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fps4l\"" Jul 08 21:36:30.515113 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.515096 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 21:36:30.515824 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.515810 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 21:36:30.522019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.521995 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm"] Jul 08 21:36:30.583769 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.583732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ztb7\" (UniqueName: \"kubernetes.io/projected/222e3612-2bbb-4255-a893-15750d67e1eb-kube-api-access-7ztb7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.583973 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.583806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.583973 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.583869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.685042 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.684996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztb7\" (UniqueName: \"kubernetes.io/projected/222e3612-2bbb-4255-a893-15750d67e1eb-kube-api-access-7ztb7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.685042 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.685052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.685242 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.685078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.685386 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.685372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.685467 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.685447 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.693049 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.693019 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ztb7\" (UniqueName: \"kubernetes.io/projected/222e3612-2bbb-4255-a893-15750d67e1eb-kube-api-access-7ztb7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.822098 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.822010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:30.947576 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:30.947543 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm"] Jul 08 21:36:30.950779 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:36:30.950755 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222e3612_2bbb_4255_a893_15750d67e1eb.slice/crio-cf331f1aeecdbd40345d16fb632c8d05ce0eec38220b3b33334646408ab5657c WatchSource:0}: Error finding container cf331f1aeecdbd40345d16fb632c8d05ce0eec38220b3b33334646408ab5657c: Status 404 returned error can't find the container with id cf331f1aeecdbd40345d16fb632c8d05ce0eec38220b3b33334646408ab5657c Jul 08 21:36:31.380942 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:31.380904 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" event={"ID":"222e3612-2bbb-4255-a893-15750d67e1eb","Type":"ContainerStarted","Data":"cf331f1aeecdbd40345d16fb632c8d05ce0eec38220b3b33334646408ab5657c"} Jul 08 21:36:39.411499 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:39.411466 2559 generic.go:356] "Generic (PLEG): container finished" podID="222e3612-2bbb-4255-a893-15750d67e1eb" containerID="e5670f1e46de2bce74591b87d68ef0155aee898dd99a8454e2cd5233127bf82c" exitCode=0 Jul 08 21:36:39.411872 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:39.411536 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" event={"ID":"222e3612-2bbb-4255-a893-15750d67e1eb","Type":"ContainerDied","Data":"e5670f1e46de2bce74591b87d68ef0155aee898dd99a8454e2cd5233127bf82c"} Jul 08 21:36:42.423357 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:42.423324 2559 generic.go:356] "Generic (PLEG): container finished" podID="222e3612-2bbb-4255-a893-15750d67e1eb" containerID="35664528909a25f07898b8ae13169c994da507c9c2e49502ccce43f0a660766e" exitCode=0 Jul 08 21:36:42.423773 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:42.423417 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" event={"ID":"222e3612-2bbb-4255-a893-15750d67e1eb","Type":"ContainerDied","Data":"35664528909a25f07898b8ae13169c994da507c9c2e49502ccce43f0a660766e"} Jul 08 21:36:49.452545 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:49.452484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" event={"ID":"222e3612-2bbb-4255-a893-15750d67e1eb","Type":"ContainerStarted","Data":"8e421fb52d5a2d709329cfdfc86ba7d572094814e42b516d0587d087232da031"} Jul 08 21:36:49.471174 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:49.471128 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" podStartSLOduration=2.71646569 podStartE2EDuration="19.471111798s" totalImagesPullingTime="16.754646108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:36:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:36:49.470532438 +0000 UTC m=+226.583527153" watchObservedRunningTime="2026-07-08 21:36:49.471111798 +0000 UTC m=+226.584106515" Jul 08 21:36:50.457756 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:50.457719 2559 generic.go:356] "Generic (PLEG): container finished" podID="222e3612-2bbb-4255-a893-15750d67e1eb" containerID="8e421fb52d5a2d709329cfdfc86ba7d572094814e42b516d0587d087232da031" exitCode=0 Jul 08 21:36:50.458170 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:50.457790 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" event={"ID":"222e3612-2bbb-4255-a893-15750d67e1eb","Type":"ContainerDied","Data":"8e421fb52d5a2d709329cfdfc86ba7d572094814e42b516d0587d087232da031"} Jul 08 21:36:51.596317 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.596292 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:51.661289 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.661251 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ztb7\" (UniqueName: \"kubernetes.io/projected/222e3612-2bbb-4255-a893-15750d67e1eb-kube-api-access-7ztb7\") pod \"222e3612-2bbb-4255-a893-15750d67e1eb\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " Jul 08 21:36:51.661289 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.661291 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-bundle\") pod \"222e3612-2bbb-4255-a893-15750d67e1eb\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " Jul 08 21:36:51.661487 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.661320 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-util\") pod \"222e3612-2bbb-4255-a893-15750d67e1eb\" (UID: \"222e3612-2bbb-4255-a893-15750d67e1eb\") " Jul 08 21:36:51.662115 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.662087 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-bundle" (OuterVolumeSpecName: "bundle") pod "222e3612-2bbb-4255-a893-15750d67e1eb" (UID: "222e3612-2bbb-4255-a893-15750d67e1eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:36:51.663444 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.663421 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/222e3612-2bbb-4255-a893-15750d67e1eb-kube-api-access-7ztb7" (OuterVolumeSpecName: "kube-api-access-7ztb7") pod "222e3612-2bbb-4255-a893-15750d67e1eb" (UID: "222e3612-2bbb-4255-a893-15750d67e1eb"). InnerVolumeSpecName "kube-api-access-7ztb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:36:51.666038 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.666008 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-util" (OuterVolumeSpecName: "util") pod "222e3612-2bbb-4255-a893-15750d67e1eb" (UID: "222e3612-2bbb-4255-a893-15750d67e1eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:36:51.762779 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.762676 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ztb7\" (UniqueName: \"kubernetes.io/projected/222e3612-2bbb-4255-a893-15750d67e1eb-kube-api-access-7ztb7\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:51.762779 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.762723 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:51.762779 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:51.762733 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/222e3612-2bbb-4255-a893-15750d67e1eb-util\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:36:52.467633 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:52.467601 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" event={"ID":"222e3612-2bbb-4255-a893-15750d67e1eb","Type":"ContainerDied","Data":"cf331f1aeecdbd40345d16fb632c8d05ce0eec38220b3b33334646408ab5657c"} Jul 08 21:36:52.467803 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:52.467645 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf331f1aeecdbd40345d16fb632c8d05ce0eec38220b3b33334646408ab5657c" Jul 08 21:36:52.467803 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:52.467670 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbfpm" Jul 08 21:36:58.547060 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.547025 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c"] Jul 08 21:36:58.547626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.547288 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222e3612-2bbb-4255-a893-15750d67e1eb" containerName="pull" Jul 08 21:36:58.547626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.547299 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="222e3612-2bbb-4255-a893-15750d67e1eb" containerName="pull" Jul 08 21:36:58.547626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.547311 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222e3612-2bbb-4255-a893-15750d67e1eb" containerName="util" Jul 08 21:36:58.547626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.547317 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="222e3612-2bbb-4255-a893-15750d67e1eb" containerName="util" Jul 08 21:36:58.547626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.547325 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222e3612-2bbb-4255-a893-15750d67e1eb" containerName="extract" Jul 08 21:36:58.547626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.547331 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="222e3612-2bbb-4255-a893-15750d67e1eb" containerName="extract" Jul 08 21:36:58.547626 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.547375 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="222e3612-2bbb-4255-a893-15750d67e1eb" containerName="extract" Jul 08 21:36:58.549713 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.549694 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" Jul 08 21:36:58.553108 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.553088 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 21:36:58.553108 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.553094 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 21:36:58.553280 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.553162 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zptgh\"" Jul 08 21:36:58.570612 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.570581 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c"] Jul 08 21:36:58.614604 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.614558 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2kb\" (UniqueName: \"kubernetes.io/projected/ea0b29cd-9837-4778-96ea-6d2926f5d6a2-kube-api-access-5q2kb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhj8c\" (UID: \"ea0b29cd-9837-4778-96ea-6d2926f5d6a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" Jul 08 21:36:58.614785 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.614635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea0b29cd-9837-4778-96ea-6d2926f5d6a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhj8c\" (UID: \"ea0b29cd-9837-4778-96ea-6d2926f5d6a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" Jul 08 21:36:58.715011 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.714974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea0b29cd-9837-4778-96ea-6d2926f5d6a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhj8c\" (UID: \"ea0b29cd-9837-4778-96ea-6d2926f5d6a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" Jul 08 21:36:58.715195 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.715052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2kb\" (UniqueName: \"kubernetes.io/projected/ea0b29cd-9837-4778-96ea-6d2926f5d6a2-kube-api-access-5q2kb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhj8c\" (UID: \"ea0b29cd-9837-4778-96ea-6d2926f5d6a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" Jul 08 21:36:58.715355 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.715333 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea0b29cd-9837-4778-96ea-6d2926f5d6a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhj8c\" (UID: \"ea0b29cd-9837-4778-96ea-6d2926f5d6a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" Jul 08 21:36:58.725487 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.725461 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2kb\" (UniqueName: \"kubernetes.io/projected/ea0b29cd-9837-4778-96ea-6d2926f5d6a2-kube-api-access-5q2kb\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhj8c\" (UID: \"ea0b29cd-9837-4778-96ea-6d2926f5d6a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" Jul 08 21:36:58.858037 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.857936 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" Jul 08 21:36:58.990677 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:58.990568 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c"] Jul 08 21:36:58.993738 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:36:58.993710 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0b29cd_9837_4778_96ea_6d2926f5d6a2.slice/crio-71e49864f128923637556b2a2bf53a85c8f8181be294d543f223bcbaab719308 WatchSource:0}: Error finding container 71e49864f128923637556b2a2bf53a85c8f8181be294d543f223bcbaab719308: Status 404 returned error can't find the container with id 71e49864f128923637556b2a2bf53a85c8f8181be294d543f223bcbaab719308 Jul 08 21:36:59.492616 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:36:59.492580 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" event={"ID":"ea0b29cd-9837-4778-96ea-6d2926f5d6a2","Type":"ContainerStarted","Data":"71e49864f128923637556b2a2bf53a85c8f8181be294d543f223bcbaab719308"} Jul 08 21:37:01.502597 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.502563 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" event={"ID":"ea0b29cd-9837-4778-96ea-6d2926f5d6a2","Type":"ContainerStarted","Data":"8b22b41f813618f4defd3b291fa9b11023c044d128b7d47a70c0ca4065f066f3"} Jul 08 21:37:01.527127 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.527067 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhj8c" podStartSLOduration=1.434624484 podStartE2EDuration="3.527044426s" totalImagesPullingTime="2.092419942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:01.526241898 +0000 UTC m=+238.639236615" watchObservedRunningTime="2026-07-08 21:37:01.527044426 +0000 UTC m=+238.640039148" Jul 08 21:37:01.812640 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.812546 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jdknr"] Jul 08 21:37:01.815804 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.815783 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:01.818386 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.818362 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 21:37:01.819069 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.819056 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 21:37:01.823712 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.823693 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jdknr"] Jul 08 21:37:01.841510 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.841481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdrm6\" (UniqueName: \"kubernetes.io/projected/0e8556f4-3178-48a9-833e-04385e372c88-kube-api-access-mdrm6\") pod \"cert-manager-webhook-6486ffd997-jdknr\" (UID: \"0e8556f4-3178-48a9-833e-04385e372c88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:01.841649 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.841574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e8556f4-3178-48a9-833e-04385e372c88-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jdknr\" (UID: \"0e8556f4-3178-48a9-833e-04385e372c88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:01.942533 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.942494 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdrm6\" (UniqueName: \"kubernetes.io/projected/0e8556f4-3178-48a9-833e-04385e372c88-kube-api-access-mdrm6\") pod \"cert-manager-webhook-6486ffd997-jdknr\" (UID: \"0e8556f4-3178-48a9-833e-04385e372c88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:01.942726 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.942583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e8556f4-3178-48a9-833e-04385e372c88-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jdknr\" (UID: \"0e8556f4-3178-48a9-833e-04385e372c88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:01.953719 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.953681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e8556f4-3178-48a9-833e-04385e372c88-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jdknr\" (UID: \"0e8556f4-3178-48a9-833e-04385e372c88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:01.953848 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:01.953812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdrm6\" (UniqueName: \"kubernetes.io/projected/0e8556f4-3178-48a9-833e-04385e372c88-kube-api-access-mdrm6\") pod \"cert-manager-webhook-6486ffd997-jdknr\" (UID: \"0e8556f4-3178-48a9-833e-04385e372c88\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:02.133841 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.133752 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:02.270319 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.270289 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jdknr"] Jul 08 21:37:02.273319 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:37:02.273289 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e8556f4_3178_48a9_833e_04385e372c88.slice/crio-8b8aeda170326e464be6874b7fd48f39d8bb445ada791d136b70d5e515322003 WatchSource:0}: Error finding container 8b8aeda170326e464be6874b7fd48f39d8bb445ada791d136b70d5e515322003: Status 404 returned error can't find the container with id 8b8aeda170326e464be6874b7fd48f39d8bb445ada791d136b70d5e515322003 Jul 08 21:37:02.508273 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.508239 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" event={"ID":"0e8556f4-3178-48a9-833e-04385e372c88","Type":"ContainerStarted","Data":"8b8aeda170326e464be6874b7fd48f39d8bb445ada791d136b70d5e515322003"} Jul 08 21:37:02.625357 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.625326 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98"] Jul 08 21:37:02.629691 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.629672 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.632162 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.632132 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 21:37:02.632162 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.632158 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fps4l\"" Jul 08 21:37:02.632845 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.632825 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 21:37:02.638634 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.638607 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98"] Jul 08 21:37:02.747802 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.747769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.747982 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.747824 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrrdg\" (UniqueName: \"kubernetes.io/projected/1e352957-b99a-4966-9395-411135ef18ef-kube-api-access-jrrdg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.747982 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.747899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.849186 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.849100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.849186 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.849155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrrdg\" (UniqueName: \"kubernetes.io/projected/1e352957-b99a-4966-9395-411135ef18ef-kube-api-access-jrrdg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.849186 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.849183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.849490 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.849471 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.849564 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.849512 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.856945 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.856915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrrdg\" (UniqueName: \"kubernetes.io/projected/1e352957-b99a-4966-9395-411135ef18ef-kube-api-access-jrrdg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:02.939721 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:02.939684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:03.066268 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:03.066240 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98"] Jul 08 21:37:03.068782 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:37:03.068754 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e352957_b99a_4966_9395_411135ef18ef.slice/crio-7002569fccd28cb5270118ec69ca3ab84a19531e940ce4ff3b877534ac440805 WatchSource:0}: Error finding container 7002569fccd28cb5270118ec69ca3ab84a19531e940ce4ff3b877534ac440805: Status 404 returned error can't find the container with id 7002569fccd28cb5270118ec69ca3ab84a19531e940ce4ff3b877534ac440805 Jul 08 21:37:03.514333 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:03.514299 2559 generic.go:356] "Generic (PLEG): container finished" podID="1e352957-b99a-4966-9395-411135ef18ef" containerID="4f32a39ae1c0dd3cb2153868dc5b648bc8f8fb7693d45476a00529ec7b9d5b75" exitCode=0 Jul 08 21:37:03.514793 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:03.514378 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" event={"ID":"1e352957-b99a-4966-9395-411135ef18ef","Type":"ContainerDied","Data":"4f32a39ae1c0dd3cb2153868dc5b648bc8f8fb7693d45476a00529ec7b9d5b75"} Jul 08 21:37:03.514793 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:03.514424 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" event={"ID":"1e352957-b99a-4966-9395-411135ef18ef","Type":"ContainerStarted","Data":"7002569fccd28cb5270118ec69ca3ab84a19531e940ce4ff3b877534ac440805"} Jul 08 21:37:05.525427 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:05.525383 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" event={"ID":"0e8556f4-3178-48a9-833e-04385e372c88","Type":"ContainerStarted","Data":"457072bc0b55b39b8f340a165a0b6e22721e70a2f861d578b67e35c3675f39d9"} Jul 08 21:37:05.525909 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:05.525463 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:05.541986 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:05.541936 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" podStartSLOduration=1.45423156 podStartE2EDuration="4.541920813s" totalImagesPullingTime="3.087689253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:05.540667369 +0000 UTC m=+242.653662091" watchObservedRunningTime="2026-07-08 21:37:05.541920813 +0000 UTC m=+242.654915532" Jul 08 21:37:06.531185 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:06.531158 2559 generic.go:356] "Generic (PLEG): container finished" podID="1e352957-b99a-4966-9395-411135ef18ef" containerID="267deacb632f3644b7874687753adc862708921e69b122f9247cb83e4b5eb442" exitCode=0 Jul 08 21:37:06.531570 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:06.531234 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" event={"ID":"1e352957-b99a-4966-9395-411135ef18ef","Type":"ContainerDied","Data":"267deacb632f3644b7874687753adc862708921e69b122f9247cb83e4b5eb442"} Jul 08 21:37:07.536961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:07.536930 2559 generic.go:356] "Generic (PLEG): container finished" podID="1e352957-b99a-4966-9395-411135ef18ef" containerID="f98d441a51ae06fbf0701011af412147724d3f4bbfedad65b88887787fa73bfc" exitCode=0 Jul 08 21:37:07.537333 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:07.536987 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" event={"ID":"1e352957-b99a-4966-9395-411135ef18ef","Type":"ContainerDied","Data":"f98d441a51ae06fbf0701011af412147724d3f4bbfedad65b88887787fa73bfc"} Jul 08 21:37:08.661446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.661421 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:08.688076 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.688038 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv"] Jul 08 21:37:08.688372 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.688356 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e352957-b99a-4966-9395-411135ef18ef" containerName="pull" Jul 08 21:37:08.688453 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.688375 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e352957-b99a-4966-9395-411135ef18ef" containerName="pull" Jul 08 21:37:08.688453 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.688405 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e352957-b99a-4966-9395-411135ef18ef" containerName="util" Jul 08 21:37:08.688453 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.688413 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e352957-b99a-4966-9395-411135ef18ef" containerName="util" Jul 08 21:37:08.688453 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.688425 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e352957-b99a-4966-9395-411135ef18ef" containerName="extract" Jul 08 21:37:08.688453 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.688434 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e352957-b99a-4966-9395-411135ef18ef" containerName="extract" Jul 08 21:37:08.688726 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.688500 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e352957-b99a-4966-9395-411135ef18ef" containerName="extract" Jul 08 21:37:08.691702 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.691681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" Jul 08 21:37:08.694067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.694050 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qdwl6\"" Jul 08 21:37:08.700931 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.700905 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv"] Jul 08 21:37:08.701633 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.701618 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-bundle\") pod \"1e352957-b99a-4966-9395-411135ef18ef\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " Jul 08 21:37:08.701688 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.701651 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-util\") pod \"1e352957-b99a-4966-9395-411135ef18ef\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " Jul 08 21:37:08.701737 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.701691 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrrdg\" (UniqueName: \"kubernetes.io/projected/1e352957-b99a-4966-9395-411135ef18ef-kube-api-access-jrrdg\") pod \"1e352957-b99a-4966-9395-411135ef18ef\" (UID: \"1e352957-b99a-4966-9395-411135ef18ef\") " Jul 08 21:37:08.702408 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.702041 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-bundle" (OuterVolumeSpecName: "bundle") pod "1e352957-b99a-4966-9395-411135ef18ef" (UID: "1e352957-b99a-4966-9395-411135ef18ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:37:08.703985 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.703957 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e352957-b99a-4966-9395-411135ef18ef-kube-api-access-jrrdg" (OuterVolumeSpecName: "kube-api-access-jrrdg") pod "1e352957-b99a-4966-9395-411135ef18ef" (UID: "1e352957-b99a-4966-9395-411135ef18ef"). InnerVolumeSpecName "kube-api-access-jrrdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:37:08.706382 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.706361 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-util" (OuterVolumeSpecName: "util") pod "1e352957-b99a-4966-9395-411135ef18ef" (UID: "1e352957-b99a-4966-9395-411135ef18ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:37:08.802924 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.802832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/750dc932-b5a2-41be-978d-eac398214646-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r2qkv\" (UID: \"750dc932-b5a2-41be-978d-eac398214646\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" Jul 08 21:37:08.802924 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.802867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl9zj\" (UniqueName: \"kubernetes.io/projected/750dc932-b5a2-41be-978d-eac398214646-kube-api-access-zl9zj\") pod \"cert-manager-cainjector-559cdd8c87-r2qkv\" (UID: \"750dc932-b5a2-41be-978d-eac398214646\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" Jul 08 21:37:08.803092 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.802978 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:37:08.803092 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.802996 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e352957-b99a-4966-9395-411135ef18ef-util\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:37:08.803092 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.803005 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrrdg\" (UniqueName: \"kubernetes.io/projected/1e352957-b99a-4966-9395-411135ef18ef-kube-api-access-jrrdg\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:37:08.904378 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.904339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/750dc932-b5a2-41be-978d-eac398214646-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r2qkv\" (UID: \"750dc932-b5a2-41be-978d-eac398214646\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" Jul 08 21:37:08.904378 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.904376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl9zj\" (UniqueName: \"kubernetes.io/projected/750dc932-b5a2-41be-978d-eac398214646-kube-api-access-zl9zj\") pod \"cert-manager-cainjector-559cdd8c87-r2qkv\" (UID: \"750dc932-b5a2-41be-978d-eac398214646\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" Jul 08 21:37:08.911835 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.911811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/750dc932-b5a2-41be-978d-eac398214646-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r2qkv\" (UID: \"750dc932-b5a2-41be-978d-eac398214646\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" Jul 08 21:37:08.911939 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:08.911856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl9zj\" (UniqueName: \"kubernetes.io/projected/750dc932-b5a2-41be-978d-eac398214646-kube-api-access-zl9zj\") pod \"cert-manager-cainjector-559cdd8c87-r2qkv\" (UID: \"750dc932-b5a2-41be-978d-eac398214646\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" Jul 08 21:37:09.002482 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:09.002439 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" Jul 08 21:37:09.124600 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:09.124557 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv"] Jul 08 21:37:09.127145 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:37:09.127121 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod750dc932_b5a2_41be_978d_eac398214646.slice/crio-32d521f49a71542ee656fc554aa48a71983aab0f3bae7b04f8481b456b097431 WatchSource:0}: Error finding container 32d521f49a71542ee656fc554aa48a71983aab0f3bae7b04f8481b456b097431: Status 404 returned error can't find the container with id 32d521f49a71542ee656fc554aa48a71983aab0f3bae7b04f8481b456b097431 Jul 08 21:37:09.547149 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:09.547111 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" event={"ID":"1e352957-b99a-4966-9395-411135ef18ef","Type":"ContainerDied","Data":"7002569fccd28cb5270118ec69ca3ab84a19531e940ce4ff3b877534ac440805"} Jul 08 21:37:09.547149 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:09.547135 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcrb98" Jul 08 21:37:09.547380 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:09.547161 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7002569fccd28cb5270118ec69ca3ab84a19531e940ce4ff3b877534ac440805" Jul 08 21:37:09.548748 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:09.548706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" event={"ID":"750dc932-b5a2-41be-978d-eac398214646","Type":"ContainerStarted","Data":"0ae9ecf8617bd1b65a7601d01dcc6e9350636497aabb828e76800174aa10ec20"} Jul 08 21:37:09.548852 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:09.548758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" event={"ID":"750dc932-b5a2-41be-978d-eac398214646","Type":"ContainerStarted","Data":"32d521f49a71542ee656fc554aa48a71983aab0f3bae7b04f8481b456b097431"} Jul 08 21:37:09.566321 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:09.566271 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r2qkv" podStartSLOduration=1.5662342200000001 podStartE2EDuration="1.56623422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:09.565619804 +0000 UTC m=+246.678614535" watchObservedRunningTime="2026-07-08 21:37:09.56623422 +0000 UTC m=+246.679228938" Jul 08 21:37:11.533504 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:11.533476 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jdknr" Jul 08 21:37:16.154159 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.154121 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm"] Jul 08 21:37:16.157664 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.157646 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" Jul 08 21:37:16.160155 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.160129 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 21:37:16.160155 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.160144 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 21:37:16.160946 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.160931 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zbwzh\"" Jul 08 21:37:16.164707 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.164686 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm"] Jul 08 21:37:16.267662 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.267618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scjv7\" (UniqueName: \"kubernetes.io/projected/ccbb44d2-5837-4b46-9c1c-86eb556a920b-kube-api-access-scjv7\") pod \"openshift-lws-operator-fd8ccff4c-2s4nm\" (UID: \"ccbb44d2-5837-4b46-9c1c-86eb556a920b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" Jul 08 21:37:16.267662 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.267665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbb44d2-5837-4b46-9c1c-86eb556a920b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2s4nm\" (UID: \"ccbb44d2-5837-4b46-9c1c-86eb556a920b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" Jul 08 21:37:16.369028 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.368997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbb44d2-5837-4b46-9c1c-86eb556a920b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2s4nm\" (UID: \"ccbb44d2-5837-4b46-9c1c-86eb556a920b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" Jul 08 21:37:16.369216 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.369081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scjv7\" (UniqueName: \"kubernetes.io/projected/ccbb44d2-5837-4b46-9c1c-86eb556a920b-kube-api-access-scjv7\") pod \"openshift-lws-operator-fd8ccff4c-2s4nm\" (UID: \"ccbb44d2-5837-4b46-9c1c-86eb556a920b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" Jul 08 21:37:16.369427 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.369406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccbb44d2-5837-4b46-9c1c-86eb556a920b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2s4nm\" (UID: \"ccbb44d2-5837-4b46-9c1c-86eb556a920b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" Jul 08 21:37:16.379473 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.379447 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scjv7\" (UniqueName: \"kubernetes.io/projected/ccbb44d2-5837-4b46-9c1c-86eb556a920b-kube-api-access-scjv7\") pod \"openshift-lws-operator-fd8ccff4c-2s4nm\" (UID: \"ccbb44d2-5837-4b46-9c1c-86eb556a920b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" Jul 08 21:37:16.468248 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.468207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" Jul 08 21:37:16.622490 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:16.622460 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm"] Jul 08 21:37:16.631562 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:37:16.631514 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccbb44d2_5837_4b46_9c1c_86eb556a920b.slice/crio-18c58e9182c3f3c6767e0b05746edc979bd8d36f07a71991713fe9efda25f6a3 WatchSource:0}: Error finding container 18c58e9182c3f3c6767e0b05746edc979bd8d36f07a71991713fe9efda25f6a3: Status 404 returned error can't find the container with id 18c58e9182c3f3c6767e0b05746edc979bd8d36f07a71991713fe9efda25f6a3 Jul 08 21:37:17.581570 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:17.581532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" event={"ID":"ccbb44d2-5837-4b46-9c1c-86eb556a920b","Type":"ContainerStarted","Data":"18c58e9182c3f3c6767e0b05746edc979bd8d36f07a71991713fe9efda25f6a3"} Jul 08 21:37:20.598345 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:20.598309 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" event={"ID":"ccbb44d2-5837-4b46-9c1c-86eb556a920b","Type":"ContainerStarted","Data":"168d6653d7608cd55fba060f55e8602f3b6ab6720b3016a06d8193e4206e089d"} Jul 08 21:37:20.615988 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:20.615944 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2s4nm" podStartSLOduration=1.2631743069999999 podStartE2EDuration="4.615926379s" totalImagesPullingTime="3.352752072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:20.614602572 +0000 UTC m=+257.727597287" watchObservedRunningTime="2026-07-08 21:37:20.615926379 +0000 UTC m=+257.728921100" Jul 08 21:37:23.040959 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.040912 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj"] Jul 08 21:37:23.043048 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.043032 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.045319 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.045298 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 21:37:23.046159 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.046143 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 21:37:23.046259 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.046155 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fps4l\"" Jul 08 21:37:23.051159 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.051137 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj"] Jul 08 21:37:23.124159 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.124119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxjf5\" (UniqueName: \"kubernetes.io/projected/c4ff4553-0392-460e-9da3-bfe3fc792b6f-kube-api-access-qxjf5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.124336 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.124166 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.124336 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.124216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.225483 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.225452 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.225645 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.225534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxjf5\" (UniqueName: \"kubernetes.io/projected/c4ff4553-0392-460e-9da3-bfe3fc792b6f-kube-api-access-qxjf5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.225645 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.225568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.225833 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.225815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.225898 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.225879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.234943 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.234919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxjf5\" (UniqueName: \"kubernetes.io/projected/c4ff4553-0392-460e-9da3-bfe3fc792b6f-kube-api-access-qxjf5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.352575 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.352461 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:23.481789 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.481767 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj"] Jul 08 21:37:23.484118 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:37:23.484086 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ff4553_0392_460e_9da3_bfe3fc792b6f.slice/crio-5c43299f0b3f9b7b3b0426bb6fcfb7c788861ef70c8376353eea8400a21ed1f9 WatchSource:0}: Error finding container 5c43299f0b3f9b7b3b0426bb6fcfb7c788861ef70c8376353eea8400a21ed1f9: Status 404 returned error can't find the container with id 5c43299f0b3f9b7b3b0426bb6fcfb7c788861ef70c8376353eea8400a21ed1f9 Jul 08 21:37:23.612026 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.611955 2559 generic.go:356] "Generic (PLEG): container finished" podID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerID="f8f85d84891eace341011350cd574226f035d30b49338ac7713300638db8575e" exitCode=0 Jul 08 21:37:23.612155 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.612038 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" event={"ID":"c4ff4553-0392-460e-9da3-bfe3fc792b6f","Type":"ContainerDied","Data":"f8f85d84891eace341011350cd574226f035d30b49338ac7713300638db8575e"} Jul 08 21:37:23.612155 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:23.612099 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" event={"ID":"c4ff4553-0392-460e-9da3-bfe3fc792b6f","Type":"ContainerStarted","Data":"5c43299f0b3f9b7b3b0426bb6fcfb7c788861ef70c8376353eea8400a21ed1f9"} Jul 08 21:37:24.618544 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:24.618448 2559 generic.go:356] "Generic (PLEG): container finished" podID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerID="04c2d780d92acb3b1464babb8464cab79f8db5c976ce5e1e3f968032a6fdbe27" exitCode=0 Jul 08 21:37:24.618912 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:24.618538 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" event={"ID":"c4ff4553-0392-460e-9da3-bfe3fc792b6f","Type":"ContainerDied","Data":"04c2d780d92acb3b1464babb8464cab79f8db5c976ce5e1e3f968032a6fdbe27"} Jul 08 21:37:25.624188 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:25.624156 2559 generic.go:356] "Generic (PLEG): container finished" podID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerID="3666f429ba9f7080c1cf49c55de980b94657957af37cbc1e5b66cb19a69f51a1" exitCode=0 Jul 08 21:37:25.624565 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:25.624231 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" event={"ID":"c4ff4553-0392-460e-9da3-bfe3fc792b6f","Type":"ContainerDied","Data":"3666f429ba9f7080c1cf49c55de980b94657957af37cbc1e5b66cb19a69f51a1"} Jul 08 21:37:26.768260 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.768239 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:26.859669 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.859632 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-bundle\") pod \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " Jul 08 21:37:26.859838 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.859696 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-util\") pod \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " Jul 08 21:37:26.859838 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.859726 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxjf5\" (UniqueName: \"kubernetes.io/projected/c4ff4553-0392-460e-9da3-bfe3fc792b6f-kube-api-access-qxjf5\") pod \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\" (UID: \"c4ff4553-0392-460e-9da3-bfe3fc792b6f\") " Jul 08 21:37:26.860430 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.860400 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-bundle" (OuterVolumeSpecName: "bundle") pod "c4ff4553-0392-460e-9da3-bfe3fc792b6f" (UID: "c4ff4553-0392-460e-9da3-bfe3fc792b6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:37:26.861826 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.861801 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4ff4553-0392-460e-9da3-bfe3fc792b6f-kube-api-access-qxjf5" (OuterVolumeSpecName: "kube-api-access-qxjf5") pod "c4ff4553-0392-460e-9da3-bfe3fc792b6f" (UID: "c4ff4553-0392-460e-9da3-bfe3fc792b6f"). InnerVolumeSpecName "kube-api-access-qxjf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:37:26.865406 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.865382 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-util" (OuterVolumeSpecName: "util") pod "c4ff4553-0392-460e-9da3-bfe3fc792b6f" (UID: "c4ff4553-0392-460e-9da3-bfe3fc792b6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:37:26.960329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.960301 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:37:26.960329 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.960327 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4ff4553-0392-460e-9da3-bfe3fc792b6f-util\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:37:26.960536 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:26.960337 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxjf5\" (UniqueName: \"kubernetes.io/projected/c4ff4553-0392-460e-9da3-bfe3fc792b6f-kube-api-access-qxjf5\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:37:27.634430 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:27.634405 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" Jul 08 21:37:27.634607 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:27.634397 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af95dpj" event={"ID":"c4ff4553-0392-460e-9da3-bfe3fc792b6f","Type":"ContainerDied","Data":"5c43299f0b3f9b7b3b0426bb6fcfb7c788861ef70c8376353eea8400a21ed1f9"} Jul 08 21:37:27.634607 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:27.634549 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c43299f0b3f9b7b3b0426bb6fcfb7c788861ef70c8376353eea8400a21ed1f9" Jul 08 21:37:35.804612 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.804578 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4"] Jul 08 21:37:35.805001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.804957 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerName="util" Jul 08 21:37:35.805001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.804970 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerName="util" Jul 08 21:37:35.805001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.804979 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerName="pull" Jul 08 21:37:35.805001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.804986 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerName="pull" Jul 08 21:37:35.805001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.804995 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerName="extract" Jul 08 21:37:35.805001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.805000 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerName="extract" Jul 08 21:37:35.805222 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.805099 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ff4553-0392-460e-9da3-bfe3fc792b6f" containerName="extract" Jul 08 21:37:35.809654 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.809637 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:35.819666 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.819644 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bsxnh\"" Jul 08 21:37:35.819843 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.819728 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 21:37:35.819843 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.819760 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 21:37:35.819982 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.819650 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 21:37:35.836914 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.836885 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4"] Jul 08 21:37:35.937666 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.937629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-metrics-cert\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:35.937856 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.937752 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v74xt\" (UniqueName: \"kubernetes.io/projected/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-kube-api-access-v74xt\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:35.937856 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.937798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-cert\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:35.937953 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:35.937854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-manager-config\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.039221 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.039185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v74xt\" (UniqueName: \"kubernetes.io/projected/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-kube-api-access-v74xt\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.039221 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.039224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-cert\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.039421 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.039325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-manager-config\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.039421 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.039350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-metrics-cert\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.040019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.039997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-manager-config\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.041771 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.041746 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-metrics-cert\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.041840 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.041788 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-cert\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.047612 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.047584 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v74xt\" (UniqueName: \"kubernetes.io/projected/758bbdf6-6ec5-4b67-b3ec-4c6061416aec-kube-api-access-v74xt\") pod \"lws-controller-manager-857546b9c4-5s2b4\" (UID: \"758bbdf6-6ec5-4b67-b3ec-4c6061416aec\") " pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.119495 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.119413 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:36.290680 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.290644 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4"] Jul 08 21:37:36.294231 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:37:36.294199 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758bbdf6_6ec5_4b67_b3ec_4c6061416aec.slice/crio-02d25f5d423d53828e101e9fc11e3b8a9329ea7d4161ec533d946e07e1196d2a WatchSource:0}: Error finding container 02d25f5d423d53828e101e9fc11e3b8a9329ea7d4161ec533d946e07e1196d2a: Status 404 returned error can't find the container with id 02d25f5d423d53828e101e9fc11e3b8a9329ea7d4161ec533d946e07e1196d2a Jul 08 21:37:36.673672 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:36.673633 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" event={"ID":"758bbdf6-6ec5-4b67-b3ec-4c6061416aec","Type":"ContainerStarted","Data":"02d25f5d423d53828e101e9fc11e3b8a9329ea7d4161ec533d946e07e1196d2a"} Jul 08 21:37:38.033586 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.033547 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g"] Jul 08 21:37:38.042781 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.042749 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.045224 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.045190 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 21:37:38.045365 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.045230 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 21:37:38.045365 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.045351 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 21:37:38.045472 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.045455 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-trgck\"" Jul 08 21:37:38.045594 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.045577 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 21:37:38.052804 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.052784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31ff14dd-e71e-4ca6-8221-f79175d1a23a-manifests\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.052905 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.052824 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31ff14dd-e71e-4ca6-8221-f79175d1a23a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.052905 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.052875 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31ff14dd-e71e-4ca6-8221-f79175d1a23a-tmp\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.052984 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.052913 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-698pg\" (UniqueName: \"kubernetes.io/projected/31ff14dd-e71e-4ca6-8221-f79175d1a23a-kube-api-access-698pg\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.053021 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.052981 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31ff14dd-e71e-4ca6-8221-f79175d1a23a-webhook-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.057449 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.057428 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g"] Jul 08 21:37:38.153700 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.153661 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-698pg\" (UniqueName: \"kubernetes.io/projected/31ff14dd-e71e-4ca6-8221-f79175d1a23a-kube-api-access-698pg\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.153884 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.153714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31ff14dd-e71e-4ca6-8221-f79175d1a23a-webhook-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.153884 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.153763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31ff14dd-e71e-4ca6-8221-f79175d1a23a-manifests\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.153884 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.153798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31ff14dd-e71e-4ca6-8221-f79175d1a23a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.153884 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.153821 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31ff14dd-e71e-4ca6-8221-f79175d1a23a-tmp\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.154193 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.154173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31ff14dd-e71e-4ca6-8221-f79175d1a23a-manifests\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.156036 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.156013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31ff14dd-e71e-4ca6-8221-f79175d1a23a-tmp\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.156256 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.156238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31ff14dd-e71e-4ca6-8221-f79175d1a23a-webhook-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.156316 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.156268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31ff14dd-e71e-4ca6-8221-f79175d1a23a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.162010 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.161990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-698pg\" (UniqueName: \"kubernetes.io/projected/31ff14dd-e71e-4ca6-8221-f79175d1a23a-kube-api-access-698pg\") pod \"opendatahub-operator-controller-manager-c97f5c75f-w5z9g\" (UID: \"31ff14dd-e71e-4ca6-8221-f79175d1a23a\") " pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.353711 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.353633 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:38.487283 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.487250 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g"] Jul 08 21:37:38.490658 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:37:38.490631 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ff14dd_e71e_4ca6_8221_f79175d1a23a.slice/crio-4a93397765a75904d13b6b631ddbbd0a3707902c4874bfd0d727a27034234e02 WatchSource:0}: Error finding container 4a93397765a75904d13b6b631ddbbd0a3707902c4874bfd0d727a27034234e02: Status 404 returned error can't find the container with id 4a93397765a75904d13b6b631ddbbd0a3707902c4874bfd0d727a27034234e02 Jul 08 21:37:38.683643 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:38.683606 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" event={"ID":"31ff14dd-e71e-4ca6-8221-f79175d1a23a","Type":"ContainerStarted","Data":"4a93397765a75904d13b6b631ddbbd0a3707902c4874bfd0d727a27034234e02"} Jul 08 21:37:41.700151 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:41.700121 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" event={"ID":"31ff14dd-e71e-4ca6-8221-f79175d1a23a","Type":"ContainerStarted","Data":"13a1b5fe663c1248cb9c9c1dd5f7f43740f725240cc3933cbc1aa8b591399c76"} Jul 08 21:37:42.706334 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:42.706292 2559 generic.go:356] "Generic (PLEG): container finished" podID="31ff14dd-e71e-4ca6-8221-f79175d1a23a" containerID="13a1b5fe663c1248cb9c9c1dd5f7f43740f725240cc3933cbc1aa8b591399c76" exitCode=0 Jul 08 21:37:42.706334 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:42.706330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" event={"ID":"31ff14dd-e71e-4ca6-8221-f79175d1a23a","Type":"ContainerDied","Data":"13a1b5fe663c1248cb9c9c1dd5f7f43740f725240cc3933cbc1aa8b591399c76"} Jul 08 21:37:43.712340 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:43.712303 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" event={"ID":"31ff14dd-e71e-4ca6-8221-f79175d1a23a","Type":"ContainerStarted","Data":"4b2ed3bd116dce3ceb86e0cb4edc6a1d99ed9029f897d75ba2986017926d701e"} Jul 08 21:37:43.712766 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:43.712399 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:43.735992 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:43.735945 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" podStartSLOduration=1.250575913 podStartE2EDuration="5.735930249s" totalImagesPullingTime="3.462362219s" totalInitContainerRuntime="1.022992117s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:43.734414221 +0000 UTC m=+280.847408962" watchObservedRunningTime="2026-07-08 21:37:43.735930249 +0000 UTC m=+280.848924966" Jul 08 21:37:46.726926 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:46.726834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" event={"ID":"758bbdf6-6ec5-4b67-b3ec-4c6061416aec","Type":"ContainerStarted","Data":"ce47def05fbbae99e703c08ca51cfe83cd27154b0df8d32c33ae0beb325b9c93"} Jul 08 21:37:46.726926 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:46.726890 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:37:46.743900 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:46.743850 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" podStartSLOduration=1.587389356 podStartE2EDuration="11.743832779s" totalImagesPullingTime="10.156443423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:46.742264603 +0000 UTC m=+283.855259318" watchObservedRunningTime="2026-07-08 21:37:46.743832779 +0000 UTC m=+283.856827553" Jul 08 21:37:54.718757 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:54.718723 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c97f5c75f-w5z9g" Jul 08 21:37:57.733318 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:37:57.733285 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-857546b9c4-5s2b4" Jul 08 21:38:03.281536 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:03.281493 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:38:03.283316 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:03.283278 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:38:03.287829 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:03.287807 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 21:38:04.974458 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:04.974419 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn"] Jul 08 21:38:04.977702 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:04.977681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:04.980564 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:04.980544 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jrmpp\"" Jul 08 21:38:04.980680 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:04.980631 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 21:38:04.980741 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:04.980700 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 21:38:04.981114 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:04.981100 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 21:38:04.995940 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:04.995911 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn"] Jul 08 21:38:05.073398 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.073630 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f320823-f669-42e7-a343-d842c26f069f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.073630 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073443 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f320823-f669-42e7-a343-d842c26f069f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.073630 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f320823-f669-42e7-a343-d842c26f069f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.073630 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.073852 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqwsj\" (UniqueName: \"kubernetes.io/projected/5f320823-f669-42e7-a343-d842c26f069f-kube-api-access-kqwsj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.073852 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.073852 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.073852 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.073774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.174671 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.174639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqwsj\" (UniqueName: \"kubernetes.io/projected/5f320823-f669-42e7-a343-d842c26f069f-kube-api-access-kqwsj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.174944 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.174681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.174944 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.174732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.174944 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.174770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.174944 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.174838 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.174944 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.174895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f320823-f669-42e7-a343-d842c26f069f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.174944 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.174918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f320823-f669-42e7-a343-d842c26f069f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.175283 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.174948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f320823-f669-42e7-a343-d842c26f069f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.175283 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.175001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.175283 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.175159 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.175446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.175319 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.175446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.175360 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.175562 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.175487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.175869 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.175846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f320823-f669-42e7-a343-d842c26f069f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.177557 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.177535 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f320823-f669-42e7-a343-d842c26f069f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.177659 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.177594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f320823-f669-42e7-a343-d842c26f069f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.187121 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.187095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f320823-f669-42e7-a343-d842c26f069f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.187262 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.187244 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqwsj\" (UniqueName: \"kubernetes.io/projected/5f320823-f669-42e7-a343-d842c26f069f-kube-api-access-kqwsj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47xmsn\" (UID: \"5f320823-f669-42e7-a343-d842c26f069f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.194202 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.194177 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd"] Jul 08 21:38:05.198462 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.198442 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.200781 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.200758 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 21:38:05.200915 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.200890 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 21:38:05.201146 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.201126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 21:38:05.201253 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.201152 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hknbd\"" Jul 08 21:38:05.209063 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.209040 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd"] Jul 08 21:38:05.275849 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.275768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.275849 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.275817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-275qb\" (UniqueName: \"kubernetes.io/projected/7d391ce9-4f16-4123-b697-b3e3b97933a9-kube-api-access-275qb\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.275849 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.275835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.276105 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.275882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.276105 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.275917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.276105 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.275987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d391ce9-4f16-4123-b697-b3e3b97933a9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.276105 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.276095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.287784 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.287756 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:05.377169 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.377129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.377317 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.377186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d391ce9-4f16-4123-b697-b3e3b97933a9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.377317 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.377266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.377317 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.377293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.377477 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.377329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-275qb\" (UniqueName: \"kubernetes.io/projected/7d391ce9-4f16-4123-b697-b3e3b97933a9-kube-api-access-275qb\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.377477 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.377359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.377477 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.377393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.378487 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.378415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.380325 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.380281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d391ce9-4f16-4123-b697-b3e3b97933a9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.380325 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.380316 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.380494 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.380468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.380697 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.380679 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.393474 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.393418 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d391ce9-4f16-4123-b697-b3e3b97933a9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.393824 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.393804 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-275qb\" (UniqueName: \"kubernetes.io/projected/7d391ce9-4f16-4123-b697-b3e3b97933a9-kube-api-access-275qb\") pod \"istiod-openshift-gateway-94bb8fbfd-c7pwd\" (UID: \"7d391ce9-4f16-4123-b697-b3e3b97933a9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.436980 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.436944 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn"] Jul 08 21:38:05.438965 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:38:05.438930 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f320823_f669_42e7_a343_d842c26f069f.slice/crio-a4513f522773c9775a39cd51c999f803e507ba1d7e69f1bcf755495b78936d07 WatchSource:0}: Error finding container a4513f522773c9775a39cd51c999f803e507ba1d7e69f1bcf755495b78936d07: Status 404 returned error can't find the container with id a4513f522773c9775a39cd51c999f803e507ba1d7e69f1bcf755495b78936d07 Jul 08 21:38:05.441001 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.440986 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 21:38:05.508380 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.508351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:05.650488 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.649906 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd"] Jul 08 21:38:05.823956 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.823857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" event={"ID":"5f320823-f669-42e7-a343-d842c26f069f","Type":"ContainerStarted","Data":"a4513f522773c9775a39cd51c999f803e507ba1d7e69f1bcf755495b78936d07"} Jul 08 21:38:05.825213 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:05.825185 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" event={"ID":"7d391ce9-4f16-4123-b697-b3e3b97933a9","Type":"ContainerStarted","Data":"e7f43657837fd7165d8a3e7b422bb5d7adf24b672fe87ab3dd3f85546f915de8"} Jul 08 21:38:09.267506 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.267460 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:38:09.267796 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.267557 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:38:09.270787 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.270759 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:38:09.275818 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.271268 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:38:09.275818 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.271439 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:38:09.854567 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.854511 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" event={"ID":"5f320823-f669-42e7-a343-d842c26f069f","Type":"ContainerStarted","Data":"0e2f1848e72de8140927ad8cefdea3282e636263674b892a4b8f5414769cc984"} Jul 08 21:38:09.856171 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.856141 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" event={"ID":"7d391ce9-4f16-4123-b697-b3e3b97933a9","Type":"ContainerStarted","Data":"c9a336843e7e3bef19cc6579237df502e6432fdba45d47f8088878a0aed23094"} Jul 08 21:38:09.856332 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.856249 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:38:09.875543 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.875466 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" podStartSLOduration=2.046024901 podStartE2EDuration="5.875450658s" totalImagesPullingTime="3.829425757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:38:09.874088803 +0000 UTC m=+306.987083518" watchObservedRunningTime="2026-07-08 21:38:09.875450658 +0000 UTC m=+306.988445375" Jul 08 21:38:09.909897 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:09.909841 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" podStartSLOduration=1.299173816 podStartE2EDuration="4.909824735s" totalImagesPullingTime="3.610650919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:38:09.90678654 +0000 UTC m=+307.019781260" watchObservedRunningTime="2026-07-08 21:38:09.909824735 +0000 UTC m=+307.022819454" Jul 08 21:38:10.288271 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:10.288233 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:10.292905 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:10.292880 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:10.861355 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:10.861322 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:10.862201 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:10.862181 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47xmsn" Jul 08 21:38:10.863169 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:38:10.863149 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c7pwd" Jul 08 21:39:14.500225 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.500182 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57"] Jul 08 21:39:14.503896 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.503875 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.506301 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.506278 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 21:39:14.507093 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.507078 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 21:39:14.507166 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.507080 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gm7tq\"" Jul 08 21:39:14.511649 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.511625 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57"] Jul 08 21:39:14.665766 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.665725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzg5v\" (UniqueName: \"kubernetes.io/projected/eaab09ac-52cf-463d-9260-a477762db7f8-kube-api-access-lzg5v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.665941 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.665808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.665941 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.665845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.767188 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.767088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.767188 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.767136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.767410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.767189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzg5v\" (UniqueName: \"kubernetes.io/projected/eaab09ac-52cf-463d-9260-a477762db7f8-kube-api-access-lzg5v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.767482 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.767460 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.767566 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.767488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.775430 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.775407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzg5v\" (UniqueName: \"kubernetes.io/projected/eaab09ac-52cf-463d-9260-a477762db7f8-kube-api-access-lzg5v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.813608 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.813568 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:14.898469 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.898440 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876"] Jul 08 21:39:14.904727 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.904705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:14.911295 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.911267 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876"] Jul 08 21:39:14.948156 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:14.948131 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57"] Jul 08 21:39:14.950627 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:39:14.950599 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaab09ac_52cf_463d_9260_a477762db7f8.slice/crio-31a620f3ff03833f04af00ebd83c5fa83b881325dc043e02549b5e74220195b3 WatchSource:0}: Error finding container 31a620f3ff03833f04af00ebd83c5fa83b881325dc043e02549b5e74220195b3: Status 404 returned error can't find the container with id 31a620f3ff03833f04af00ebd83c5fa83b881325dc043e02549b5e74220195b3 Jul 08 21:39:15.070188 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.070161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.070312 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.070247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67r8x\" (UniqueName: \"kubernetes.io/projected/06174813-b248-48fd-a609-277e6d639b65-kube-api-access-67r8x\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.070312 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.070280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.137782 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.137750 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaab09ac-52cf-463d-9260-a477762db7f8" containerID="7ea6d9c9b8ffd9b90596d584efa22a307bf5186e70604aca3e4fce7ab46563e7" exitCode=0 Jul 08 21:39:15.137962 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.137812 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" event={"ID":"eaab09ac-52cf-463d-9260-a477762db7f8","Type":"ContainerDied","Data":"7ea6d9c9b8ffd9b90596d584efa22a307bf5186e70604aca3e4fce7ab46563e7"} Jul 08 21:39:15.137962 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.137860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" event={"ID":"eaab09ac-52cf-463d-9260-a477762db7f8","Type":"ContainerStarted","Data":"31a620f3ff03833f04af00ebd83c5fa83b881325dc043e02549b5e74220195b3"} Jul 08 21:39:15.170694 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.170669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.170842 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.170705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.170842 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.170775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67r8x\" (UniqueName: \"kubernetes.io/projected/06174813-b248-48fd-a609-277e6d639b65-kube-api-access-67r8x\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.171044 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.171024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.171119 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.171088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.179375 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.179356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67r8x\" (UniqueName: \"kubernetes.io/projected/06174813-b248-48fd-a609-277e6d639b65-kube-api-access-67r8x\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.216494 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.216464 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:15.299579 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.299056 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242"] Jul 08 21:39:15.303714 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.303662 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.309681 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.309655 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242"] Jul 08 21:39:15.351369 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.351303 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876"] Jul 08 21:39:15.353358 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:39:15.353329 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06174813_b248_48fd_a609_277e6d639b65.slice/crio-6ff03ad1ff51bf931aee1823f34ec57718b04a1628c13dbdf94a99ba47ebb61d WatchSource:0}: Error finding container 6ff03ad1ff51bf931aee1823f34ec57718b04a1628c13dbdf94a99ba47ebb61d: Status 404 returned error can't find the container with id 6ff03ad1ff51bf931aee1823f34ec57718b04a1628c13dbdf94a99ba47ebb61d Jul 08 21:39:15.473167 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.473136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7zz\" (UniqueName: \"kubernetes.io/projected/cb232953-43ca-4c92-819d-c7ac50ccdb13-kube-api-access-jl7zz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.473298 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.473179 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.473298 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.473204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.574283 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.574200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7zz\" (UniqueName: \"kubernetes.io/projected/cb232953-43ca-4c92-819d-c7ac50ccdb13-kube-api-access-jl7zz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.574283 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.574249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.574704 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.574372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.574704 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.574628 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.574704 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.574671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.582202 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.582173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7zz\" (UniqueName: \"kubernetes.io/projected/cb232953-43ca-4c92-819d-c7ac50ccdb13-kube-api-access-jl7zz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.615413 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.615388 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:15.697699 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.697670 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl"] Jul 08 21:39:15.701396 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.701371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.709647 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.709624 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl"] Jul 08 21:39:15.750199 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.747547 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242"] Jul 08 21:39:15.776558 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.776500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.776713 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.776630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.776805 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.776785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bp7x\" (UniqueName: \"kubernetes.io/projected/6f94466d-f09b-481c-be9e-43fa44bc66f9-kube-api-access-8bp7x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.790027 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:39:15.789997 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb232953_43ca_4c92_819d_c7ac50ccdb13.slice/crio-02e4ea1a79796ed7716bcf00223471698060fbd94dc2b2db9f61932aa07d7401 WatchSource:0}: Error finding container 02e4ea1a79796ed7716bcf00223471698060fbd94dc2b2db9f61932aa07d7401: Status 404 returned error can't find the container with id 02e4ea1a79796ed7716bcf00223471698060fbd94dc2b2db9f61932aa07d7401 Jul 08 21:39:15.877727 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.877674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bp7x\" (UniqueName: \"kubernetes.io/projected/6f94466d-f09b-481c-be9e-43fa44bc66f9-kube-api-access-8bp7x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.877727 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.877722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.877875 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.877751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.878135 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.878111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.878219 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.878122 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:15.887880 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:15.887854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bp7x\" (UniqueName: \"kubernetes.io/projected/6f94466d-f09b-481c-be9e-43fa44bc66f9-kube-api-access-8bp7x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:16.013565 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.013503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:16.141599 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.141578 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl"] Jul 08 21:39:16.144056 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:39:16.144024 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f94466d_f09b_481c_be9e_43fa44bc66f9.slice/crio-3611c312739e47f3ad2b3a9c3e439b0d06cdb082130b7ed75224198385fec36b WatchSource:0}: Error finding container 3611c312739e47f3ad2b3a9c3e439b0d06cdb082130b7ed75224198385fec36b: Status 404 returned error can't find the container with id 3611c312739e47f3ad2b3a9c3e439b0d06cdb082130b7ed75224198385fec36b Jul 08 21:39:16.145413 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.145393 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaab09ac-52cf-463d-9260-a477762db7f8" containerID="7ec09d878119a469423ceb36aba32bfb31c9508a8588a29cc99cc3c388016a0d" exitCode=0 Jul 08 21:39:16.145508 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.145471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" event={"ID":"eaab09ac-52cf-463d-9260-a477762db7f8","Type":"ContainerDied","Data":"7ec09d878119a469423ceb36aba32bfb31c9508a8588a29cc99cc3c388016a0d"} Jul 08 21:39:16.146999 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.146925 2559 generic.go:356] "Generic (PLEG): container finished" podID="06174813-b248-48fd-a609-277e6d639b65" containerID="e6390aa8f144403c53040af8c9a7cb79559ed5e47ee1e7f849e1300fdd395c9f" exitCode=0 Jul 08 21:39:16.146999 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.146991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" event={"ID":"06174813-b248-48fd-a609-277e6d639b65","Type":"ContainerDied","Data":"e6390aa8f144403c53040af8c9a7cb79559ed5e47ee1e7f849e1300fdd395c9f"} Jul 08 21:39:16.147151 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.147027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" event={"ID":"06174813-b248-48fd-a609-277e6d639b65","Type":"ContainerStarted","Data":"6ff03ad1ff51bf931aee1823f34ec57718b04a1628c13dbdf94a99ba47ebb61d"} Jul 08 21:39:16.148555 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.148532 2559 generic.go:356] "Generic (PLEG): container finished" podID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerID="5b26127d8e1cd454f7cacf8323181e0c7e7a98e3e727785d445229b24503430a" exitCode=0 Jul 08 21:39:16.148674 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.148567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" event={"ID":"cb232953-43ca-4c92-819d-c7ac50ccdb13","Type":"ContainerDied","Data":"5b26127d8e1cd454f7cacf8323181e0c7e7a98e3e727785d445229b24503430a"} Jul 08 21:39:16.148674 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:16.148643 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" event={"ID":"cb232953-43ca-4c92-819d-c7ac50ccdb13","Type":"ContainerStarted","Data":"02e4ea1a79796ed7716bcf00223471698060fbd94dc2b2db9f61932aa07d7401"} Jul 08 21:39:17.155531 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:17.155434 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaab09ac-52cf-463d-9260-a477762db7f8" containerID="df17b00c41cb53439f253e22957a8fbb2853793c6d28a84e953d4ec5e1cc02ec" exitCode=0 Jul 08 21:39:17.155952 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:17.155554 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" event={"ID":"eaab09ac-52cf-463d-9260-a477762db7f8","Type":"ContainerDied","Data":"df17b00c41cb53439f253e22957a8fbb2853793c6d28a84e953d4ec5e1cc02ec"} Jul 08 21:39:17.157372 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:17.157347 2559 generic.go:356] "Generic (PLEG): container finished" podID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerID="4925fc0d153cc1178d50a6ca03a8b59c6f2f24f6d29fe43dab916d890e955a5d" exitCode=0 Jul 08 21:39:17.157502 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:17.157419 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" event={"ID":"cb232953-43ca-4c92-819d-c7ac50ccdb13","Type":"ContainerDied","Data":"4925fc0d153cc1178d50a6ca03a8b59c6f2f24f6d29fe43dab916d890e955a5d"} Jul 08 21:39:17.158994 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:17.158971 2559 generic.go:356] "Generic (PLEG): container finished" podID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerID="62af9035ab97954e4c3b84eafde7394c916516dcd07d72e8947c95fba01dc1b5" exitCode=0 Jul 08 21:39:17.159076 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:17.159056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" event={"ID":"6f94466d-f09b-481c-be9e-43fa44bc66f9","Type":"ContainerDied","Data":"62af9035ab97954e4c3b84eafde7394c916516dcd07d72e8947c95fba01dc1b5"} Jul 08 21:39:17.159114 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:17.159102 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" event={"ID":"6f94466d-f09b-481c-be9e-43fa44bc66f9","Type":"ContainerStarted","Data":"3611c312739e47f3ad2b3a9c3e439b0d06cdb082130b7ed75224198385fec36b"} Jul 08 21:39:18.165376 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.165286 2559 generic.go:356] "Generic (PLEG): container finished" podID="06174813-b248-48fd-a609-277e6d639b65" containerID="8c062a24a43d171a84a02a451ab6647e62bc8e55cc66b902044e1d4d5c3c93bf" exitCode=0 Jul 08 21:39:18.165842 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.165375 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" event={"ID":"06174813-b248-48fd-a609-277e6d639b65","Type":"ContainerDied","Data":"8c062a24a43d171a84a02a451ab6647e62bc8e55cc66b902044e1d4d5c3c93bf"} Jul 08 21:39:18.167600 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.167581 2559 generic.go:356] "Generic (PLEG): container finished" podID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerID="1e3c48198f8520a8b8b50cc62ebefe953f8d7d7235464d4d0d6db4ce4ae651f8" exitCode=0 Jul 08 21:39:18.167679 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.167648 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" event={"ID":"cb232953-43ca-4c92-819d-c7ac50ccdb13","Type":"ContainerDied","Data":"1e3c48198f8520a8b8b50cc62ebefe953f8d7d7235464d4d0d6db4ce4ae651f8"} Jul 08 21:39:18.169466 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.169448 2559 generic.go:356] "Generic (PLEG): container finished" podID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerID="c2f88be33d6c2d40432ae4381a76405df897646d406727237aa453583047a651" exitCode=0 Jul 08 21:39:18.169567 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.169476 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" event={"ID":"6f94466d-f09b-481c-be9e-43fa44bc66f9","Type":"ContainerDied","Data":"c2f88be33d6c2d40432ae4381a76405df897646d406727237aa453583047a651"} Jul 08 21:39:18.295941 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.295918 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:18.402154 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.402124 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-util\") pod \"eaab09ac-52cf-463d-9260-a477762db7f8\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " Jul 08 21:39:18.402335 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.402178 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-bundle\") pod \"eaab09ac-52cf-463d-9260-a477762db7f8\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " Jul 08 21:39:18.402335 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.402227 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzg5v\" (UniqueName: \"kubernetes.io/projected/eaab09ac-52cf-463d-9260-a477762db7f8-kube-api-access-lzg5v\") pod \"eaab09ac-52cf-463d-9260-a477762db7f8\" (UID: \"eaab09ac-52cf-463d-9260-a477762db7f8\") " Jul 08 21:39:18.402624 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.402603 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-bundle" (OuterVolumeSpecName: "bundle") pod "eaab09ac-52cf-463d-9260-a477762db7f8" (UID: "eaab09ac-52cf-463d-9260-a477762db7f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:39:18.404315 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.404296 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaab09ac-52cf-463d-9260-a477762db7f8-kube-api-access-lzg5v" (OuterVolumeSpecName: "kube-api-access-lzg5v") pod "eaab09ac-52cf-463d-9260-a477762db7f8" (UID: "eaab09ac-52cf-463d-9260-a477762db7f8"). InnerVolumeSpecName "kube-api-access-lzg5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:39:18.408080 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.408057 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-util" (OuterVolumeSpecName: "util") pod "eaab09ac-52cf-463d-9260-a477762db7f8" (UID: "eaab09ac-52cf-463d-9260-a477762db7f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:39:18.503021 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.502989 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-util\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:18.503021 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.503018 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eaab09ac-52cf-463d-9260-a477762db7f8-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:18.503021 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:18.503028 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzg5v\" (UniqueName: \"kubernetes.io/projected/eaab09ac-52cf-463d-9260-a477762db7f8-kube-api-access-lzg5v\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:19.175761 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.175674 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" Jul 08 21:39:19.176158 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.175671 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57" event={"ID":"eaab09ac-52cf-463d-9260-a477762db7f8","Type":"ContainerDied","Data":"31a620f3ff03833f04af00ebd83c5fa83b881325dc043e02549b5e74220195b3"} Jul 08 21:39:19.176158 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.175808 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31a620f3ff03833f04af00ebd83c5fa83b881325dc043e02549b5e74220195b3" Jul 08 21:39:19.177619 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.177598 2559 generic.go:356] "Generic (PLEG): container finished" podID="06174813-b248-48fd-a609-277e6d639b65" containerID="45b6d02e9c801fcf2ea73e7e06a561a2aa5243f181cf66ddae603bb6faaa42fc" exitCode=0 Jul 08 21:39:19.177735 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.177662 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" event={"ID":"06174813-b248-48fd-a609-277e6d639b65","Type":"ContainerDied","Data":"45b6d02e9c801fcf2ea73e7e06a561a2aa5243f181cf66ddae603bb6faaa42fc"} Jul 08 21:39:19.185799 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.185766 2559 generic.go:356] "Generic (PLEG): container finished" podID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerID="88c8b09b5357e7b05a2f664e522920346b133d80a629e235ac0906f780093d22" exitCode=0 Jul 08 21:39:19.185925 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.185846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" event={"ID":"6f94466d-f09b-481c-be9e-43fa44bc66f9","Type":"ContainerDied","Data":"88c8b09b5357e7b05a2f664e522920346b133d80a629e235ac0906f780093d22"} Jul 08 21:39:19.318208 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.318184 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:19.408502 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.408472 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-bundle\") pod \"cb232953-43ca-4c92-819d-c7ac50ccdb13\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " Jul 08 21:39:19.408674 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.408538 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-util\") pod \"cb232953-43ca-4c92-819d-c7ac50ccdb13\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " Jul 08 21:39:19.408674 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.408578 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl7zz\" (UniqueName: \"kubernetes.io/projected/cb232953-43ca-4c92-819d-c7ac50ccdb13-kube-api-access-jl7zz\") pod \"cb232953-43ca-4c92-819d-c7ac50ccdb13\" (UID: \"cb232953-43ca-4c92-819d-c7ac50ccdb13\") " Jul 08 21:39:19.409114 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.409092 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-bundle" (OuterVolumeSpecName: "bundle") pod "cb232953-43ca-4c92-819d-c7ac50ccdb13" (UID: "cb232953-43ca-4c92-819d-c7ac50ccdb13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:39:19.410701 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.410678 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb232953-43ca-4c92-819d-c7ac50ccdb13-kube-api-access-jl7zz" (OuterVolumeSpecName: "kube-api-access-jl7zz") pod "cb232953-43ca-4c92-819d-c7ac50ccdb13" (UID: "cb232953-43ca-4c92-819d-c7ac50ccdb13"). InnerVolumeSpecName "kube-api-access-jl7zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:39:19.414059 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.414013 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-util" (OuterVolumeSpecName: "util") pod "cb232953-43ca-4c92-819d-c7ac50ccdb13" (UID: "cb232953-43ca-4c92-819d-c7ac50ccdb13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:39:19.509915 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.509883 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl7zz\" (UniqueName: \"kubernetes.io/projected/cb232953-43ca-4c92-819d-c7ac50ccdb13-kube-api-access-jl7zz\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:19.509915 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.509911 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:19.509915 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:19.509922 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb232953-43ca-4c92-819d-c7ac50ccdb13-util\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:20.192050 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.192021 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" Jul 08 21:39:20.192050 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.192039 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242" event={"ID":"cb232953-43ca-4c92-819d-c7ac50ccdb13","Type":"ContainerDied","Data":"02e4ea1a79796ed7716bcf00223471698060fbd94dc2b2db9f61932aa07d7401"} Jul 08 21:39:20.192625 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.192099 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02e4ea1a79796ed7716bcf00223471698060fbd94dc2b2db9f61932aa07d7401" Jul 08 21:39:20.343304 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.343279 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:20.363134 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.363110 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:20.520067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.519990 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-util\") pod \"06174813-b248-48fd-a609-277e6d639b65\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " Jul 08 21:39:20.520067 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.520032 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bp7x\" (UniqueName: \"kubernetes.io/projected/6f94466d-f09b-481c-be9e-43fa44bc66f9-kube-api-access-8bp7x\") pod \"6f94466d-f09b-481c-be9e-43fa44bc66f9\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " Jul 08 21:39:20.520271 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.520093 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67r8x\" (UniqueName: \"kubernetes.io/projected/06174813-b248-48fd-a609-277e6d639b65-kube-api-access-67r8x\") pod \"06174813-b248-48fd-a609-277e6d639b65\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " Jul 08 21:39:20.520271 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.520112 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-bundle\") pod \"06174813-b248-48fd-a609-277e6d639b65\" (UID: \"06174813-b248-48fd-a609-277e6d639b65\") " Jul 08 21:39:20.520271 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.520128 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-bundle\") pod \"6f94466d-f09b-481c-be9e-43fa44bc66f9\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " Jul 08 21:39:20.520271 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.520149 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-util\") pod \"6f94466d-f09b-481c-be9e-43fa44bc66f9\" (UID: \"6f94466d-f09b-481c-be9e-43fa44bc66f9\") " Jul 08 21:39:20.520641 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.520614 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-bundle" (OuterVolumeSpecName: "bundle") pod "06174813-b248-48fd-a609-277e6d639b65" (UID: "06174813-b248-48fd-a609-277e6d639b65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:39:20.520778 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.520751 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-bundle" (OuterVolumeSpecName: "bundle") pod "6f94466d-f09b-481c-be9e-43fa44bc66f9" (UID: "6f94466d-f09b-481c-be9e-43fa44bc66f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:39:20.522705 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.522675 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06174813-b248-48fd-a609-277e6d639b65-kube-api-access-67r8x" (OuterVolumeSpecName: "kube-api-access-67r8x") pod "06174813-b248-48fd-a609-277e6d639b65" (UID: "06174813-b248-48fd-a609-277e6d639b65"). InnerVolumeSpecName "kube-api-access-67r8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:39:20.522955 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.522937 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f94466d-f09b-481c-be9e-43fa44bc66f9-kube-api-access-8bp7x" (OuterVolumeSpecName: "kube-api-access-8bp7x") pod "6f94466d-f09b-481c-be9e-43fa44bc66f9" (UID: "6f94466d-f09b-481c-be9e-43fa44bc66f9"). InnerVolumeSpecName "kube-api-access-8bp7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:39:20.525844 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.525818 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-util" (OuterVolumeSpecName: "util") pod "6f94466d-f09b-481c-be9e-43fa44bc66f9" (UID: "6f94466d-f09b-481c-be9e-43fa44bc66f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:39:20.526148 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.526124 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-util" (OuterVolumeSpecName: "util") pod "06174813-b248-48fd-a609-277e6d639b65" (UID: "06174813-b248-48fd-a609-277e6d639b65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:39:20.621119 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.621086 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bp7x\" (UniqueName: \"kubernetes.io/projected/6f94466d-f09b-481c-be9e-43fa44bc66f9-kube-api-access-8bp7x\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:20.621119 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.621113 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67r8x\" (UniqueName: \"kubernetes.io/projected/06174813-b248-48fd-a609-277e6d639b65-kube-api-access-67r8x\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:20.621119 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.621122 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:20.621334 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.621130 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-bundle\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:20.621334 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.621138 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f94466d-f09b-481c-be9e-43fa44bc66f9-util\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:20.621334 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:20.621144 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06174813-b248-48fd-a609-277e6d639b65-util\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:39:21.198305 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:21.198279 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" Jul 08 21:39:21.198744 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:21.198276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876" event={"ID":"06174813-b248-48fd-a609-277e6d639b65","Type":"ContainerDied","Data":"6ff03ad1ff51bf931aee1823f34ec57718b04a1628c13dbdf94a99ba47ebb61d"} Jul 08 21:39:21.198744 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:21.198401 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ff03ad1ff51bf931aee1823f34ec57718b04a1628c13dbdf94a99ba47ebb61d" Jul 08 21:39:21.200062 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:21.200039 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" event={"ID":"6f94466d-f09b-481c-be9e-43fa44bc66f9","Type":"ContainerDied","Data":"3611c312739e47f3ad2b3a9c3e439b0d06cdb082130b7ed75224198385fec36b"} Jul 08 21:39:21.200062 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:21.200051 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl" Jul 08 21:39:21.200269 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:39:21.200072 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3611c312739e47f3ad2b3a9c3e439b0d06cdb082130b7ed75224198385fec36b" Jul 08 21:40:55.139261 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139221 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139556 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerName="pull" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139567 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerName="pull" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139578 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06174813-b248-48fd-a609-277e6d639b65" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139585 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06174813-b248-48fd-a609-277e6d639b65" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139592 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerName="pull" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139599 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerName="pull" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139605 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139610 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139617 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaab09ac-52cf-463d-9260-a477762db7f8" containerName="pull" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139623 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaab09ac-52cf-463d-9260-a477762db7f8" containerName="pull" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139633 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaab09ac-52cf-463d-9260-a477762db7f8" containerName="util" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139637 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaab09ac-52cf-463d-9260-a477762db7f8" containerName="util" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139644 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaab09ac-52cf-463d-9260-a477762db7f8" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139650 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaab09ac-52cf-463d-9260-a477762db7f8" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139654 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06174813-b248-48fd-a609-277e6d639b65" containerName="pull" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139659 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06174813-b248-48fd-a609-277e6d639b65" containerName="pull" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139664 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139668 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139674 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06174813-b248-48fd-a609-277e6d639b65" containerName="util" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139679 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="06174813-b248-48fd-a609-277e6d639b65" containerName="util" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139684 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerName="util" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139690 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerName="util" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139697 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerName="util" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139702 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerName="util" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139753 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaab09ac-52cf-463d-9260-a477762db7f8" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139760 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f94466d-f09b-481c-be9e-43fa44bc66f9" containerName="extract" Jul 08 21:40:55.139753 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139767 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb232953-43ca-4c92-819d-c7ac50ccdb13" containerName="extract" Jul 08 21:40:55.140584 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.139772 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="06174813-b248-48fd-a609-277e6d639b65" containerName="extract" Jul 08 21:40:55.142499 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.142484 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:55.149027 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.148976 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 21:40:55.149027 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.149000 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 21:40:55.149853 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.149829 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 21:40:55.149948 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.149858 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gm7tq\"" Jul 08 21:40:55.156648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.156625 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:40:55.190840 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.190804 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:40:55.264484 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.264446 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6n67\" (UniqueName: \"kubernetes.io/projected/1d208004-2d58-4663-9709-0b7e08487d79-kube-api-access-w6n67\") pod \"limitador-limitador-54d6d988d5-pc8pm\" (UID: \"1d208004-2d58-4663-9709-0b7e08487d79\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:55.264484 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.264489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1d208004-2d58-4663-9709-0b7e08487d79-config-file\") pod \"limitador-limitador-54d6d988d5-pc8pm\" (UID: \"1d208004-2d58-4663-9709-0b7e08487d79\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:55.365906 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.365870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6n67\" (UniqueName: \"kubernetes.io/projected/1d208004-2d58-4663-9709-0b7e08487d79-kube-api-access-w6n67\") pod \"limitador-limitador-54d6d988d5-pc8pm\" (UID: \"1d208004-2d58-4663-9709-0b7e08487d79\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:55.366077 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.365911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1d208004-2d58-4663-9709-0b7e08487d79-config-file\") pod \"limitador-limitador-54d6d988d5-pc8pm\" (UID: \"1d208004-2d58-4663-9709-0b7e08487d79\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:55.366606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.366587 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1d208004-2d58-4663-9709-0b7e08487d79-config-file\") pod \"limitador-limitador-54d6d988d5-pc8pm\" (UID: \"1d208004-2d58-4663-9709-0b7e08487d79\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:55.382053 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.382022 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6n67\" (UniqueName: \"kubernetes.io/projected/1d208004-2d58-4663-9709-0b7e08487d79-kube-api-access-w6n67\") pod \"limitador-limitador-54d6d988d5-pc8pm\" (UID: \"1d208004-2d58-4663-9709-0b7e08487d79\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:55.452777 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.452746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:55.593452 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.593429 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:40:55.595831 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:40:55.595802 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d208004_2d58_4663_9709_0b7e08487d79.slice/crio-2d941a6bacab7f4931492e16f4e825bcea8fdb30016702ea558b72fbc8f227fd WatchSource:0}: Error finding container 2d941a6bacab7f4931492e16f4e825bcea8fdb30016702ea558b72fbc8f227fd: Status 404 returned error can't find the container with id 2d941a6bacab7f4931492e16f4e825bcea8fdb30016702ea558b72fbc8f227fd Jul 08 21:40:55.645346 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:55.645312 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" event={"ID":"1d208004-2d58-4663-9709-0b7e08487d79","Type":"ContainerStarted","Data":"2d941a6bacab7f4931492e16f4e825bcea8fdb30016702ea558b72fbc8f227fd"} Jul 08 21:40:58.663754 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:58.663718 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" event={"ID":"1d208004-2d58-4663-9709-0b7e08487d79","Type":"ContainerStarted","Data":"8e04ca54c92627042c653d8e7daf9a5f51cf3fcd845d1a67538e4c874b54d79a"} Jul 08 21:40:58.664151 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:58.663886 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:40:58.683654 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:40:58.681949 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" podStartSLOduration=1.27956045 podStartE2EDuration="3.681930148s" totalImagesPullingTime="2.402369698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:40:58.679100328 +0000 UTC m=+475.792095058" watchObservedRunningTime="2026-07-08 21:40:58.681930148 +0000 UTC m=+475.794924869" Jul 08 21:41:09.670183 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:41:09.670154 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pc8pm" Jul 08 21:42:08.773226 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:42:08.773193 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:42:29.202020 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:42:29.201972 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:42:41.308885 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:42:41.308846 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:42:55.044671 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:42:55.044632 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:43:02.589896 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.589853 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4"] Jul 08 21:43:02.593314 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.593292 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.596916 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.596897 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mwth9\"" Jul 08 21:43:02.597035 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.596918 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 21:43:02.597035 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.596931 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 21:43:02.597035 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.597012 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 21:43:02.603869 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.603842 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4"] Jul 08 21:43:02.661080 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.661044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.661256 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.661099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8chvn\" (UniqueName: \"kubernetes.io/projected/999e4365-a5a3-4a6a-ae08-c1dea32150d8-kube-api-access-8chvn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.661256 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.661124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/999e4365-a5a3-4a6a-ae08-c1dea32150d8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.661256 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.661158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.661413 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.661273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.661413 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.661327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.761849 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.761812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.762047 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.761865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.762047 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.761890 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.762047 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.761918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8chvn\" (UniqueName: \"kubernetes.io/projected/999e4365-a5a3-4a6a-ae08-c1dea32150d8-kube-api-access-8chvn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.762047 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.761937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/999e4365-a5a3-4a6a-ae08-c1dea32150d8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.762047 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.761961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.762381 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.762337 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.762494 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.762390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.762494 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.762348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.764151 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.764122 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/999e4365-a5a3-4a6a-ae08-c1dea32150d8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.764299 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.764280 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/999e4365-a5a3-4a6a-ae08-c1dea32150d8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.770458 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.770431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8chvn\" (UniqueName: \"kubernetes.io/projected/999e4365-a5a3-4a6a-ae08-c1dea32150d8-kube-api-access-8chvn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4\" (UID: \"999e4365-a5a3-4a6a-ae08-c1dea32150d8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:02.904162 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:02.904064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:03.037937 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:03.037911 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4"] Jul 08 21:43:03.039866 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:43:03.039838 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999e4365_a5a3_4a6a_ae08_c1dea32150d8.slice/crio-0e96ff46d1a4130d0a168143122ee36c742077390157af25134a6ee331e9dde8 WatchSource:0}: Error finding container 0e96ff46d1a4130d0a168143122ee36c742077390157af25134a6ee331e9dde8: Status 404 returned error can't find the container with id 0e96ff46d1a4130d0a168143122ee36c742077390157af25134a6ee331e9dde8 Jul 08 21:43:03.263987 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:03.263920 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" event={"ID":"999e4365-a5a3-4a6a-ae08-c1dea32150d8","Type":"ContainerStarted","Data":"0e96ff46d1a4130d0a168143122ee36c742077390157af25134a6ee331e9dde8"} Jul 08 21:43:03.338705 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:03.338652 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:43:03.339399 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:03.339375 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:43:04.199801 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:04.199770 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:43:04.270403 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:04.270361 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" event={"ID":"999e4365-a5a3-4a6a-ae08-c1dea32150d8","Type":"ContainerStarted","Data":"13ba4436f5f1e21221de4f6eefe9e3f2d8768ca58023d0552b00650c37171af6"} Jul 08 21:43:04.292924 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:04.292477 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" podStartSLOduration=1.258851902 podStartE2EDuration="2.292457937s" totalImagesPullingTime="1.033606035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:43:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:43:04.292101684 +0000 UTC m=+601.405096402" watchObservedRunningTime="2026-07-08 21:43:04.292457937 +0000 UTC m=+601.405452656" Jul 08 21:43:11.513763 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:11.513726 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:43:12.904360 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:12.904324 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:12.904855 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:12.904393 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:12.917123 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:12.917096 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:13.327398 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:13.327368 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4" Jul 08 21:43:21.003133 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:43:21.003095 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:44:44.697057 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:44:44.697017 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:44:54.502561 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:44:54.502468 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:45:00.154024 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.153947 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w"] Jul 08 21:45:00.157138 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.157119 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" Jul 08 21:45:00.159862 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.159841 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 21:45:00.160721 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.160706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-m94p2\"" Jul 08 21:45:00.160774 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.160709 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 21:45:00.166138 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.166114 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w"] Jul 08 21:45:00.260986 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.260950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw2xm\" (UniqueName: \"kubernetes.io/projected/b38e54ae-e98d-4007-9b27-19f0b379a2e9-kube-api-access-cw2xm\") pod \"maas-api-key-cleanup-29725785-z4q4w\" (UID: \"b38e54ae-e98d-4007-9b27-19f0b379a2e9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" Jul 08 21:45:00.361940 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.361898 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw2xm\" (UniqueName: \"kubernetes.io/projected/b38e54ae-e98d-4007-9b27-19f0b379a2e9-kube-api-access-cw2xm\") pod \"maas-api-key-cleanup-29725785-z4q4w\" (UID: \"b38e54ae-e98d-4007-9b27-19f0b379a2e9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" Jul 08 21:45:00.370697 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.370673 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw2xm\" (UniqueName: \"kubernetes.io/projected/b38e54ae-e98d-4007-9b27-19f0b379a2e9-kube-api-access-cw2xm\") pod \"maas-api-key-cleanup-29725785-z4q4w\" (UID: \"b38e54ae-e98d-4007-9b27-19f0b379a2e9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" Jul 08 21:45:00.468032 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.467996 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" Jul 08 21:45:00.594649 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.594625 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w"] Jul 08 21:45:00.596855 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:45:00.596829 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38e54ae_e98d_4007_9b27_19f0b379a2e9.slice/crio-82111a1094a160e30483afd8fce7b454c26bcce030f6fd70317b50b4a4c9da61 WatchSource:0}: Error finding container 82111a1094a160e30483afd8fce7b454c26bcce030f6fd70317b50b4a4c9da61: Status 404 returned error can't find the container with id 82111a1094a160e30483afd8fce7b454c26bcce030f6fd70317b50b4a4c9da61 Jul 08 21:45:00.598768 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.598753 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 21:45:00.829119 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:00.829028 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" event={"ID":"b38e54ae-e98d-4007-9b27-19f0b379a2e9","Type":"ContainerStarted","Data":"82111a1094a160e30483afd8fce7b454c26bcce030f6fd70317b50b4a4c9da61"} Jul 08 21:45:03.846750 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:03.846714 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" event={"ID":"b38e54ae-e98d-4007-9b27-19f0b379a2e9","Type":"ContainerStarted","Data":"85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88"} Jul 08 21:45:03.861174 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:03.861123 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" podStartSLOduration=1.761040208 podStartE2EDuration="3.861108818s" totalImagesPullingTime="2.10006861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:45:03.860312739 +0000 UTC m=+720.973307458" watchObservedRunningTime="2026-07-08 21:45:03.861108818 +0000 UTC m=+720.974103535" Jul 08 21:45:05.301758 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:05.301722 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:45:15.204047 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:15.204014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:45:28.399251 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:28.399210 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:45:54.103269 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:45:54.103237 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:46:00.011317 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:00.011229 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w"] Jul 08 21:46:00.011724 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:00.011433 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" podUID="b38e54ae-e98d-4007-9b27-19f0b379a2e9" containerName="cleanup" containerID="cri-o://85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88" gracePeriod=30 Jul 08 21:46:04.995697 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:04.995663 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:46:30.184731 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.184707 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" Jul 08 21:46:30.255766 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.255731 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw2xm\" (UniqueName: \"kubernetes.io/projected/b38e54ae-e98d-4007-9b27-19f0b379a2e9-kube-api-access-cw2xm\") pod \"b38e54ae-e98d-4007-9b27-19f0b379a2e9\" (UID: \"b38e54ae-e98d-4007-9b27-19f0b379a2e9\") " Jul 08 21:46:30.257873 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.257849 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b38e54ae-e98d-4007-9b27-19f0b379a2e9-kube-api-access-cw2xm" (OuterVolumeSpecName: "kube-api-access-cw2xm") pod "b38e54ae-e98d-4007-9b27-19f0b379a2e9" (UID: "b38e54ae-e98d-4007-9b27-19f0b379a2e9"). InnerVolumeSpecName "kube-api-access-cw2xm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:46:30.267225 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.267167 2559 generic.go:356] "Generic (PLEG): container finished" podID="b38e54ae-e98d-4007-9b27-19f0b379a2e9" containerID="85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88" exitCode=137 Jul 08 21:46:30.267225 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.267204 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" Jul 08 21:46:30.267225 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.267210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" event={"ID":"b38e54ae-e98d-4007-9b27-19f0b379a2e9","Type":"ContainerDied","Data":"85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88"} Jul 08 21:46:30.267381 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.267252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w" event={"ID":"b38e54ae-e98d-4007-9b27-19f0b379a2e9","Type":"ContainerDied","Data":"82111a1094a160e30483afd8fce7b454c26bcce030f6fd70317b50b4a4c9da61"} Jul 08 21:46:30.267381 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.267273 2559 scope.go:117] "RemoveContainer" containerID="85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88" Jul 08 21:46:30.276147 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.276124 2559 scope.go:117] "RemoveContainer" containerID="85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88" Jul 08 21:46:30.276391 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:46:30.276374 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88\": container with ID starting with 85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88 not found: ID does not exist" containerID="85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88" Jul 08 21:46:30.276455 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.276406 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88"} err="failed to get container status \"85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88\": rpc error: code = NotFound desc = could not find container \"85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88\": container with ID starting with 85d81f719b15db052905cdbf5b16be2a6e6e76e95adc03ef88185a1ac72e2c88 not found: ID does not exist" Jul 08 21:46:30.287946 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.287920 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w"] Jul 08 21:46:30.291962 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.291937 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-z4q4w"] Jul 08 21:46:30.356687 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:30.356657 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw2xm\" (UniqueName: \"kubernetes.io/projected/b38e54ae-e98d-4007-9b27-19f0b379a2e9-kube-api-access-cw2xm\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:46:31.443859 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:31.443831 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b38e54ae-e98d-4007-9b27-19f0b379a2e9" path="/var/lib/kubelet/pods/b38e54ae-e98d-4007-9b27-19f0b379a2e9/volumes" Jul 08 21:46:39.298399 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:39.298363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:46:48.495002 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:48.494969 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:46:56.096775 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:46:56.096739 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:47:03.396583 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:47:03.396558 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:47:13.912847 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:47:13.912811 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:47:23.194336 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:47:23.194296 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:47:34.800745 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:47:34.800708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:47:45.196578 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:47:45.196542 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:48:03.372474 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:48:03.372393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:48:03.374493 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:48:03.374473 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:48:07.605258 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:48:07.605224 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:48:19.196974 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:48:19.196939 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:48:41.804256 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:48:41.804215 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:48:53.899600 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:48:53.899560 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:49:09.494729 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:49:09.494697 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:49:18.699957 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:49:18.699918 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:49:28.205606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:49:28.205504 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:49:37.397866 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:49:37.397831 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:49:46.199707 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:49:46.199670 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:51:34.494956 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:51:34.494919 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:51:42.998237 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:51:42.998192 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:51:55.602441 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:51:55.602397 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:52:05.397646 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:52:05.397608 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:52:16.701477 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:52:16.701438 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:52:27.393643 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:52:27.393603 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:52:34.793627 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:52:34.793590 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:52:43.398126 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:52:43.398086 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:52:51.604652 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:52:51.604611 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:53:02.298933 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:53:02.298897 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:53:03.406834 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:53:03.406802 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:53:03.407734 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:53:03.407716 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:53:37.995870 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:53:37.995836 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:53:46.500005 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:53:46.499962 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:53:57.895783 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:53:57.895706 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:54:07.308046 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:54:07.308005 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:54:23.634738 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:54:23.634698 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:54:32.497486 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:54:32.497450 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:54:41.405146 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:54:41.405102 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:54:51.800948 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:54:51.800912 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:55:01.203855 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:55:01.203818 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:55:10.593644 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:55:10.593605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:55:23.513498 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:55:23.513467 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:55:32.303460 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:55:32.303424 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:55:41.207568 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:55:41.207531 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:55:52.493648 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:55:52.493610 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:56:04.614089 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:56:04.614053 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:56:12.201571 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:56:12.201537 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:56:24.402054 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:56:24.402015 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:56:35.099245 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:56:35.099204 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:56:44.705028 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:56:44.704993 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:56:52.002744 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:56:52.002711 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:57:02.207958 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:02.207869 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:57:14.100017 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:14.099971 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:57:22.600918 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:22.600880 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:57:29.137090 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.137059 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j"] Jul 08 21:57:29.137446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.137404 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38e54ae-e98d-4007-9b27-19f0b379a2e9" containerName="cleanup" Jul 08 21:57:29.137446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.137415 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38e54ae-e98d-4007-9b27-19f0b379a2e9" containerName="cleanup" Jul 08 21:57:29.137528 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.137498 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b38e54ae-e98d-4007-9b27-19f0b379a2e9" containerName="cleanup" Jul 08 21:57:29.140671 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.140652 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.143179 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.143157 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-36ae606b-openshift-default-dockercfg-4s9jm\"" Jul 08 21:57:29.165303 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.165267 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j"] Jul 08 21:57:29.318024 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.317990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-credential-socket\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.318024 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.318032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-data\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.318241 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.318057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b128ac1-ce7f-484f-a859-1d95873e49d7-istiod-ca-cert\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.318241 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.318144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-podinfo\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.318241 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.318188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-socket\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.318241 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.318222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-certs\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.318369 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.318241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-httzv\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-kube-api-access-httzv\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.318369 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.318269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-envoy\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.318369 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.318283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-token\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.418895 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.418807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-certs\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.418895 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.418843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-httzv\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-kube-api-access-httzv\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.418895 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.418871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-envoy\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.418895 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.418885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-token\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419228 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.418921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-credential-socket\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419228 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.418942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-data\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419228 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.418962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b128ac1-ce7f-484f-a859-1d95873e49d7-istiod-ca-cert\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419228 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.418983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-podinfo\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419228 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.419020 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-socket\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419402 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.419272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-certs\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419438 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.419407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-credential-socket\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419473 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.419442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-data\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419541 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.419490 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-socket\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.419846 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.419821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b128ac1-ce7f-484f-a859-1d95873e49d7-istiod-ca-cert\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.421220 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.421198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-envoy\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.421471 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.421454 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-podinfo\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.426803 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.426780 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-token\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.427232 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.427213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-httzv\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-kube-api-access-httzv\") pod \"e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.452315 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.452291 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:29.589159 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.589131 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j"] Jul 08 21:57:29.591449 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:57:29.591423 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b128ac1_ce7f_484f_a859_1d95873e49d7.slice/crio-9682e85a3a4a0f21664e9f9f67610975d4460af91a28cfb21f745f4d5433c925 WatchSource:0}: Error finding container 9682e85a3a4a0f21664e9f9f67610975d4460af91a28cfb21f745f4d5433c925: Status 404 returned error can't find the container with id 9682e85a3a4a0f21664e9f9f67610975d4460af91a28cfb21f745f4d5433c925 Jul 08 21:57:29.594103 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.594071 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:29.594175 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.594142 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:29.594175 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:29.594171 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:30.499383 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:30.499344 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" event={"ID":"3b128ac1-ce7f-484f-a859-1d95873e49d7","Type":"ContainerStarted","Data":"2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6"} Jul 08 21:57:30.499887 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:30.499396 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" event={"ID":"3b128ac1-ce7f-484f-a859-1d95873e49d7","Type":"ContainerStarted","Data":"9682e85a3a4a0f21664e9f9f67610975d4460af91a28cfb21f745f4d5433c925"} Jul 08 21:57:30.521378 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:30.521326 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" podStartSLOduration=1.5213121969999999 podStartE2EDuration="1.521312197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:57:30.519350304 +0000 UTC m=+1467.632345022" watchObservedRunningTime="2026-07-08 21:57:30.521312197 +0000 UTC m=+1467.634306992" Jul 08 21:57:31.452600 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:31.452565 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:31.457564 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:31.457536 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:31.504772 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:31.504737 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:31.505743 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:31.505724 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:35.592459 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:35.592425 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j"] Jul 08 21:57:35.592911 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:35.592627 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" podUID="3b128ac1-ce7f-484f-a859-1d95873e49d7" containerName="istio-proxy" containerID="cri-o://2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6" gracePeriod=30 Jul 08 21:57:35.804380 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:35.804347 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:57:40.831013 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.830985 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:40.924749 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.924670 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-podinfo\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.924749 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.924708 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-data\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.924977 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.924751 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-credential-socket\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.924977 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.924850 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b128ac1-ce7f-484f-a859-1d95873e49d7-istiod-ca-cert\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.924977 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.924905 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-httzv\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-kube-api-access-httzv\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.925131 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.924996 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-certs\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.925131 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.924992 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:57:40.925131 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925029 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-socket\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.925131 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925054 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-token\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.925131 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925026 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:57:40.925131 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925090 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-envoy\") pod \"3b128ac1-ce7f-484f-a859-1d95873e49d7\" (UID: \"3b128ac1-ce7f-484f-a859-1d95873e49d7\") " Jul 08 21:57:40.925399 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925221 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:57:40.925399 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925240 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b128ac1-ce7f-484f-a859-1d95873e49d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:57:40.925399 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925374 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:57:40.925513 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925443 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:40.925513 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925465 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b128ac1-ce7f-484f-a859-1d95873e49d7-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:40.925513 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925480 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:40.925513 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925492 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:40.925513 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.925504 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:40.927237 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.927198 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:57:40.927356 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.927256 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-kube-api-access-httzv" (OuterVolumeSpecName: "kube-api-access-httzv") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "kube-api-access-httzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:57:40.927413 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.927365 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 21:57:40.927487 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:40.927418 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b128ac1-ce7f-484f-a859-1d95873e49d7" (UID: "3b128ac1-ce7f-484f-a859-1d95873e49d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:57:41.026200 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.026168 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:41.026200 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.026194 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:41.026200 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.026202 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b128ac1-ce7f-484f-a859-1d95873e49d7-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:41.026420 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.026214 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-httzv\" (UniqueName: \"kubernetes.io/projected/3b128ac1-ce7f-484f-a859-1d95873e49d7-kube-api-access-httzv\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:57:41.554108 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.554075 2559 generic.go:356] "Generic (PLEG): container finished" podID="3b128ac1-ce7f-484f-a859-1d95873e49d7" containerID="2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6" exitCode=0 Jul 08 21:57:41.554280 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.554126 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" Jul 08 21:57:41.554280 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.554169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" event={"ID":"3b128ac1-ce7f-484f-a859-1d95873e49d7","Type":"ContainerDied","Data":"2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6"} Jul 08 21:57:41.554280 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.554237 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j" event={"ID":"3b128ac1-ce7f-484f-a859-1d95873e49d7","Type":"ContainerDied","Data":"9682e85a3a4a0f21664e9f9f67610975d4460af91a28cfb21f745f4d5433c925"} Jul 08 21:57:41.554280 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.554260 2559 scope.go:117] "RemoveContainer" containerID="2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6" Jul 08 21:57:41.567116 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.567097 2559 scope.go:117] "RemoveContainer" containerID="2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6" Jul 08 21:57:41.567390 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:57:41.567366 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6\": container with ID starting with 2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6 not found: ID does not exist" containerID="2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6" Jul 08 21:57:41.567444 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.567393 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6"} err="failed to get container status \"2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6\": rpc error: code = NotFound desc = could not find container \"2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6\": container with ID starting with 2c9cda90cfdc3d0d197457131cb66d3f04488742cd6893faacf8b6f5a389b1c6 not found: ID does not exist" Jul 08 21:57:41.573540 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.573493 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j"] Jul 08 21:57:41.577232 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.577210 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-36ae606b-openshift-default-55bf8c55df-xgj8j"] Jul 08 21:57:41.905492 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.905411 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4"] Jul 08 21:57:41.906121 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.906090 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b128ac1-ce7f-484f-a859-1d95873e49d7" containerName="istio-proxy" Jul 08 21:57:41.906267 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.906253 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b128ac1-ce7f-484f-a859-1d95873e49d7" containerName="istio-proxy" Jul 08 21:57:41.906490 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.906469 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b128ac1-ce7f-484f-a859-1d95873e49d7" containerName="istio-proxy" Jul 08 21:57:41.911048 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.911025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.913385 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.913363 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e369240b-openshift-default-dockercfg-6kl7z\"" Jul 08 21:57:41.923573 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.923549 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4"] Jul 08 21:57:41.933191 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-data\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.933293 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933197 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-podinfo\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.933293 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7s7s\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-kube-api-access-g7s7s\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.933293 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-socket\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.933446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-token\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.933446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-certs\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.933446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-credential-socket\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.933446 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istiod-ca-cert\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:41.933625 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:41.933449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-envoy\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034797 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-data\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034990 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034803 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-podinfo\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034990 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7s7s\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-kube-api-access-g7s7s\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034990 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-socket\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034990 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-token\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034990 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-certs\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034990 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-credential-socket\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034990 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istiod-ca-cert\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.034990 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.034964 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-envoy\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.035401 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.035224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-socket\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.035401 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.035332 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-certs\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.035581 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.035424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-data\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.035581 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.035496 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-credential-socket\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.035830 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.035810 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istiod-ca-cert\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.037186 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.037165 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-envoy\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.037312 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.037295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-podinfo\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.042680 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.042653 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-token\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.042756 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.042743 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7s7s\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-kube-api-access-g7s7s\") pod \"e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.224898 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.224867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:42.363005 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.362981 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4"] Jul 08 21:57:42.365041 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:57:42.365013 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485a1dff_6bdf_4390_8106_ec4f3c5d81d8.slice/crio-597ff1b7db07089bbd142d4611f134958b33dd99a4d24adef0180db6504f2226 WatchSource:0}: Error finding container 597ff1b7db07089bbd142d4611f134958b33dd99a4d24adef0180db6504f2226: Status 404 returned error can't find the container with id 597ff1b7db07089bbd142d4611f134958b33dd99a4d24adef0180db6504f2226 Jul 08 21:57:42.367041 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.367006 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:42.367133 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.367072 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:42.367133 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.367103 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:42.561289 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.561190 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" event={"ID":"485a1dff-6bdf-4390-8106-ec4f3c5d81d8","Type":"ContainerStarted","Data":"6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac"} Jul 08 21:57:42.561289 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.561251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" event={"ID":"485a1dff-6bdf-4390-8106-ec4f3c5d81d8","Type":"ContainerStarted","Data":"597ff1b7db07089bbd142d4611f134958b33dd99a4d24adef0180db6504f2226"} Jul 08 21:57:42.583702 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:42.583649 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" podStartSLOduration=1.583632414 podStartE2EDuration="1.583632414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:57:42.58077792 +0000 UTC m=+1479.693772639" watchObservedRunningTime="2026-07-08 21:57:42.583632414 +0000 UTC m=+1479.696627131" Jul 08 21:57:43.225682 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:43.225645 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:43.226704 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:43.226678 2559 patch_prober.go:28] interesting pod/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 08 21:57:43.226796 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:43.226730 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 08 21:57:43.446924 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:43.446887 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b128ac1-ce7f-484f-a859-1d95873e49d7" path="/var/lib/kubelet/pods/3b128ac1-ce7f-484f-a859-1d95873e49d7/volumes" Jul 08 21:57:44.228915 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:44.228880 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:44.572170 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:44.572082 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:44.573162 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:44.573139 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:44.903088 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:44.903005 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:57:53.618668 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:53.618633 2559 generic.go:356] "Generic (PLEG): container finished" podID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerID="6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac" exitCode=0 Jul 08 21:57:53.618668 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:53.618670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" event={"ID":"485a1dff-6bdf-4390-8106-ec4f3c5d81d8","Type":"ContainerDied","Data":"6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac"} Jul 08 21:57:53.619214 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:53.619035 2559 scope.go:117] "RemoveContainer" containerID="6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac" Jul 08 21:57:53.620037 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:53.620010 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:53.620100 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:53.620073 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:53.620144 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:53.620133 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:57:54.275757 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:54.275721 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4"] Jul 08 21:57:54.625862 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:54.625764 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" event={"ID":"485a1dff-6bdf-4390-8106-ec4f3c5d81d8","Type":"ContainerStarted","Data":"9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91"} Jul 08 21:57:54.625862 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:54.625789 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerName="istio-proxy" containerID="cri-o://9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91" gracePeriod=30 Jul 08 21:57:56.196707 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:56.196674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:57:59.572806 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:59.572766 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:57:59.860224 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:57:59.860201 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:58:00.002320 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002288 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-socket\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002320 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002321 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-envoy\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002388 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-credential-socket\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002417 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-token\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002447 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-data\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002479 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-podinfo\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002512 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7s7s\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-kube-api-access-g7s7s\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002563 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istiod-ca-cert\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002606 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002605 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-certs\") pod \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\" (UID: \"485a1dff-6bdf-4390-8106-ec4f3c5d81d8\") " Jul 08 21:58:00.002961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002651 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:00.002961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002735 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:00.002961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002907 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.002961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002926 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:00.002961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002936 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.003154 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.002999 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:58:00.003561 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.003508 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:00.004681 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.004656 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:58:00.005041 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.005010 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-kube-api-access-g7s7s" (OuterVolumeSpecName: "kube-api-access-g7s7s") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "kube-api-access-g7s7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:58:00.005119 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.005056 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:00.005119 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.005054 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "485a1dff-6bdf-4390-8106-ec4f3c5d81d8" (UID: "485a1dff-6bdf-4390-8106-ec4f3c5d81d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 21:58:00.103410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.103327 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.103410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.103355 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.103410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.103366 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.103410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.103378 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7s7s\" (UniqueName: \"kubernetes.io/projected/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-kube-api-access-g7s7s\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.103410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.103391 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.103410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.103403 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.103410 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.103415 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485a1dff-6bdf-4390-8106-ec4f3c5d81d8-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:00.297719 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.297685 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw"] Jul 08 21:58:00.298185 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.298169 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerName="istio-proxy" Jul 08 21:58:00.298229 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.298189 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerName="istio-proxy" Jul 08 21:58:00.298229 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.298207 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerName="istio-proxy" Jul 08 21:58:00.298229 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.298215 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerName="istio-proxy" Jul 08 21:58:00.298323 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.298284 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerName="istio-proxy" Jul 08 21:58:00.300539 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.300495 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.302926 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.302906 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bfd8243f-openshift-default-dockercfg-8ksjj\"" Jul 08 21:58:00.313952 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.313927 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw"] Jul 08 21:58:00.406422 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-credential-socket\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.406422 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-envoy\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.406422 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtc7c\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-kube-api-access-rtc7c\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.406714 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/460edc2b-e459-4df6-9ea3-94d96f755596-istio-podinfo\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.406714 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-socket\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.406714 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406623 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-data\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.406714 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-istio-token\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.406714 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/460edc2b-e459-4df6-9ea3-94d96f755596-istiod-ca-cert\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.406714 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.406692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-certs\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.507685 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-envoy\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.507685 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtc7c\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-kube-api-access-rtc7c\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.507934 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507744 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/460edc2b-e459-4df6-9ea3-94d96f755596-istio-podinfo\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.507934 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-socket\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.507934 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507826 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-data\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.507934 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-istio-token\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.507934 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/460edc2b-e459-4df6-9ea3-94d96f755596-istiod-ca-cert\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.507934 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-certs\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.508248 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.507990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-credential-socket\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.508300 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.508238 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-socket\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.508358 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.508321 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-certs\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.508417 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.508392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-data\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.508602 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.508578 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-credential-socket\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.508687 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.508663 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/460edc2b-e459-4df6-9ea3-94d96f755596-istiod-ca-cert\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.510007 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.509986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-envoy\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.510206 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.510189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/460edc2b-e459-4df6-9ea3-94d96f755596-istio-podinfo\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.515957 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.515934 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-istio-token\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.516240 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.516224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtc7c\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-kube-api-access-rtc7c\") pod \"e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.611223 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.611190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:00.658058 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.657965 2559 generic.go:356] "Generic (PLEG): container finished" podID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerID="9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91" exitCode=0 Jul 08 21:58:00.658058 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.658014 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" Jul 08 21:58:00.658239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.658051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" event={"ID":"485a1dff-6bdf-4390-8106-ec4f3c5d81d8","Type":"ContainerDied","Data":"9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91"} Jul 08 21:58:00.658239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.658114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4" event={"ID":"485a1dff-6bdf-4390-8106-ec4f3c5d81d8","Type":"ContainerDied","Data":"597ff1b7db07089bbd142d4611f134958b33dd99a4d24adef0180db6504f2226"} Jul 08 21:58:00.658239 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.658148 2559 scope.go:117] "RemoveContainer" containerID="9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91" Jul 08 21:58:00.669908 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.669060 2559 scope.go:117] "RemoveContainer" containerID="6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac" Jul 08 21:58:00.679961 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.679940 2559 scope.go:117] "RemoveContainer" containerID="9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91" Jul 08 21:58:00.680287 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:58:00.680253 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91\": container with ID starting with 9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91 not found: ID does not exist" containerID="9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91" Jul 08 21:58:00.680372 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.680297 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91"} err="failed to get container status \"9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91\": rpc error: code = NotFound desc = could not find container \"9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91\": container with ID starting with 9f98f2ecdb1e16eb24a93cdd87c5f2f5e23ade835bb922450fb9f3add6758d91 not found: ID does not exist" Jul 08 21:58:00.680372 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.680314 2559 scope.go:117] "RemoveContainer" containerID="6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac" Jul 08 21:58:00.680582 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:58:00.680562 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac\": container with ID starting with 6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac not found: ID does not exist" containerID="6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac" Jul 08 21:58:00.680636 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.680588 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac"} err="failed to get container status \"6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac\": rpc error: code = NotFound desc = could not find container \"6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac\": container with ID starting with 6e00c54c3d95f6f416f970b91a08999a56dbda6f17a47823963dba422736f0ac not found: ID does not exist" Jul 08 21:58:00.686313 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.686290 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4"] Jul 08 21:58:00.694650 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.694625 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e369240b-openshift-default-75df7bdf89-lqnf4"] Jul 08 21:58:00.749200 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.749178 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw"] Jul 08 21:58:00.751483 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:58:00.751460 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460edc2b_e459_4df6_9ea3_94d96f755596.slice/crio-4c5b642bb1efe84a6e43cb01fbde34fca2cddd34f73e4864deabc0351e3648cc WatchSource:0}: Error finding container 4c5b642bb1efe84a6e43cb01fbde34fca2cddd34f73e4864deabc0351e3648cc: Status 404 returned error can't find the container with id 4c5b642bb1efe84a6e43cb01fbde34fca2cddd34f73e4864deabc0351e3648cc Jul 08 21:58:00.753770 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.753732 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:58:00.753855 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.753811 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:58:00.753893 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:00.753854 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:58:01.444693 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:01.444656 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" path="/var/lib/kubelet/pods/485a1dff-6bdf-4390-8106-ec4f3c5d81d8/volumes" Jul 08 21:58:01.664600 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:01.664560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" event={"ID":"460edc2b-e459-4df6-9ea3-94d96f755596","Type":"ContainerStarted","Data":"17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4"} Jul 08 21:58:01.665071 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:01.664626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" event={"ID":"460edc2b-e459-4df6-9ea3-94d96f755596","Type":"ContainerStarted","Data":"4c5b642bb1efe84a6e43cb01fbde34fca2cddd34f73e4864deabc0351e3648cc"} Jul 08 21:58:02.611530 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:02.611490 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:02.616274 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:02.616249 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:02.643056 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:02.642996 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" podStartSLOduration=2.642976927 podStartE2EDuration="2.642976927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:58:01.721567545 +0000 UTC m=+1498.834562263" watchObservedRunningTime="2026-07-08 21:58:02.642976927 +0000 UTC m=+1499.755971646" Jul 08 21:58:02.670208 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:02.670176 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:02.671062 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:02.671043 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:03.438380 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:03.438348 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:58:03.441034 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:03.441007 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 21:58:04.099552 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:04.099508 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:58:06.042971 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:06.042931 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw"] Jul 08 21:58:06.043396 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:06.043162 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" podUID="460edc2b-e459-4df6-9ea3-94d96f755596" containerName="istio-proxy" containerID="cri-o://17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4" gracePeriod=30 Jul 08 21:58:11.689782 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.689758 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:11.717825 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.717793 2559 generic.go:356] "Generic (PLEG): container finished" podID="460edc2b-e459-4df6-9ea3-94d96f755596" containerID="17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4" exitCode=0 Jul 08 21:58:11.717976 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.717853 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" Jul 08 21:58:11.717976 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.717872 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" event={"ID":"460edc2b-e459-4df6-9ea3-94d96f755596","Type":"ContainerDied","Data":"17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4"} Jul 08 21:58:11.717976 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.717928 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw" event={"ID":"460edc2b-e459-4df6-9ea3-94d96f755596","Type":"ContainerDied","Data":"4c5b642bb1efe84a6e43cb01fbde34fca2cddd34f73e4864deabc0351e3648cc"} Jul 08 21:58:11.717976 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.717954 2559 scope.go:117] "RemoveContainer" containerID="17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4" Jul 08 21:58:11.726728 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.726707 2559 scope.go:117] "RemoveContainer" containerID="17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4" Jul 08 21:58:11.726987 ip-10-0-143-77 kubenswrapper[2559]: E0708 21:58:11.726962 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4\": container with ID starting with 17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4 not found: ID does not exist" containerID="17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4" Jul 08 21:58:11.727048 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.726992 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4"} err="failed to get container status \"17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4\": rpc error: code = NotFound desc = could not find container \"17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4\": container with ID starting with 17f434736f1ec075499defe15905e244ab2383832f02ae5ab2444a95f984d8c4 not found: ID does not exist" Jul 08 21:58:11.822328 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822230 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-istio-token\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822328 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822268 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/460edc2b-e459-4df6-9ea3-94d96f755596-istiod-ca-cert\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822328 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822325 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-envoy\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822598 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822358 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-credential-socket\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822598 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822388 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtc7c\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-kube-api-access-rtc7c\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822598 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822419 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-certs\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822598 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822483 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/460edc2b-e459-4df6-9ea3-94d96f755596-istio-podinfo\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822598 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822507 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-socket\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822598 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822549 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-data\") pod \"460edc2b-e459-4df6-9ea3-94d96f755596\" (UID: \"460edc2b-e459-4df6-9ea3-94d96f755596\") " Jul 08 21:58:11.822897 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822704 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:11.822897 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822788 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/460edc2b-e459-4df6-9ea3-94d96f755596-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 21:58:11.822897 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822863 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/460edc2b-e459-4df6-9ea3-94d96f755596-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:11.822897 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.822880 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:11.823106 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.823021 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:11.823106 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.823087 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:11.823455 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.823439 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-data" (OuterVolumeSpecName: "istio-data") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:11.825012 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.824976 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-istio-token" (OuterVolumeSpecName: "istio-token") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:58:11.825127 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.825020 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 21:58:11.825127 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.825038 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-kube-api-access-rtc7c" (OuterVolumeSpecName: "kube-api-access-rtc7c") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "kube-api-access-rtc7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 21:58:11.825127 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.825039 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/460edc2b-e459-4df6-9ea3-94d96f755596-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "460edc2b-e459-4df6-9ea3-94d96f755596" (UID: "460edc2b-e459-4df6-9ea3-94d96f755596"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 21:58:11.924235 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.924197 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:11.924235 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.924226 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtc7c\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-kube-api-access-rtc7c\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:11.924235 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.924235 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:11.924235 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.924247 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/460edc2b-e459-4df6-9ea3-94d96f755596-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:11.924488 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.924255 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:11.924488 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.924262 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/460edc2b-e459-4df6-9ea3-94d96f755596-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:11.924488 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:11.924270 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/460edc2b-e459-4df6-9ea3-94d96f755596-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 21:58:12.040242 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:12.040215 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw"] Jul 08 21:58:12.044214 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:12.044184 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bfd8243f-openshift-default-7dcb6689b7-ljsjw"] Jul 08 21:58:12.464684 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:12.464639 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:58:13.443891 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:58:13.443858 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460edc2b-e459-4df6-9ea3-94d96f755596" path="/var/lib/kubelet/pods/460edc2b-e459-4df6-9ea3-94d96f755596/volumes" Jul 08 21:59:33.501434 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:33.501399 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:59:42.100490 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:42.100458 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 21:59:46.572852 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.572819 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g"] Jul 08 21:59:46.573225 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.573169 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460edc2b-e459-4df6-9ea3-94d96f755596" containerName="istio-proxy" Jul 08 21:59:46.573225 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.573180 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="460edc2b-e459-4df6-9ea3-94d96f755596" containerName="istio-proxy" Jul 08 21:59:46.573302 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.573249 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="460edc2b-e459-4df6-9ea3-94d96f755596" containerName="istio-proxy" Jul 08 21:59:46.573302 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.573261 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="485a1dff-6bdf-4390-8106-ec4f3c5d81d8" containerName="istio-proxy" Jul 08 21:59:46.576192 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.576176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.578863 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.578841 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6c8ebf0a-openshift-default-dockercfg-7lb8w\"" Jul 08 21:59:46.601233 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.601207 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g"] Jul 08 21:59:46.651739 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.651702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-istio-token\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.651916 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.651748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-socket\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.651916 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.651832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-credential-socket\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.651916 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.651881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-certs\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.651916 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.651909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dff997-07bc-4c63-b807-4d1546d252d3-istiod-ca-cert\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.652138 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.651939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-envoy\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.652138 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.652002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-data\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.652138 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.652025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbnb9\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-kube-api-access-fbnb9\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.652138 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.652053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dff997-07bc-4c63-b807-4d1546d252d3-istio-podinfo\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.752762 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752725 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-data\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.752762 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbnb9\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-kube-api-access-fbnb9\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dff997-07bc-4c63-b807-4d1546d252d3-istio-podinfo\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-istio-token\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-socket\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-credential-socket\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-certs\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dff997-07bc-4c63-b807-4d1546d252d3-istiod-ca-cert\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753019 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.752996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-envoy\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.753196 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-data\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.753275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-socket\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.753318 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-certs\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753409 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.753374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-credential-socket\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.753726 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.753702 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dff997-07bc-4c63-b807-4d1546d252d3-istiod-ca-cert\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.755314 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.755298 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dff997-07bc-4c63-b807-4d1546d252d3-istio-podinfo\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.755375 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.755328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-envoy\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.761341 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.761319 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbnb9\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-kube-api-access-fbnb9\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.761507 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.761405 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-istio-token\") pod \"e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:46.886671 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:46.886584 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:47.019413 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:47.019387 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g"] Jul 08 21:59:47.021143 ip-10-0-143-77 kubenswrapper[2559]: W0708 21:59:47.021113 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00dff997_07bc_4c63_b807_4d1546d252d3.slice/crio-6a64eba0bd22304d76f271b955a61e70d130cc22e07f7d0ab415868ca6c561eb WatchSource:0}: Error finding container 6a64eba0bd22304d76f271b955a61e70d130cc22e07f7d0ab415868ca6c561eb: Status 404 returned error can't find the container with id 6a64eba0bd22304d76f271b955a61e70d130cc22e07f7d0ab415868ca6c561eb Jul 08 21:59:47.023212 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:47.023184 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:59:47.023322 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:47.023257 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:59:47.023322 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:47.023302 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 21:59:47.178968 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:47.178877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" event={"ID":"00dff997-07bc-4c63-b807-4d1546d252d3","Type":"ContainerStarted","Data":"a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78"} Jul 08 21:59:47.178968 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:47.178936 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" event={"ID":"00dff997-07bc-4c63-b807-4d1546d252d3","Type":"ContainerStarted","Data":"6a64eba0bd22304d76f271b955a61e70d130cc22e07f7d0ab415868ca6c561eb"} Jul 08 21:59:47.200051 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:47.200001 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" podStartSLOduration=1.199979934 podStartE2EDuration="1.199979934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:59:47.198021976 +0000 UTC m=+1604.311016731" watchObservedRunningTime="2026-07-08 21:59:47.199979934 +0000 UTC m=+1604.312974651" Jul 08 21:59:47.887338 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:47.887303 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:48.891875 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:48.891839 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:49.188536 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:49.188492 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:49.189638 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:49.189619 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 21:59:54.010937 ip-10-0-143-77 kubenswrapper[2559]: I0708 21:59:54.010849 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:00:02.254942 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:02.254906 2559 generic.go:356] "Generic (PLEG): container finished" podID="00dff997-07bc-4c63-b807-4d1546d252d3" containerID="a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78" exitCode=0 Jul 08 22:00:02.255353 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:02.254983 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" event={"ID":"00dff997-07bc-4c63-b807-4d1546d252d3","Type":"ContainerDied","Data":"a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78"} Jul 08 22:00:02.255394 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:02.255357 2559 scope.go:117] "RemoveContainer" containerID="a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78" Jul 08 22:00:02.256327 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:02.256304 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:02.256380 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:02.256368 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:02.256414 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:02.256406 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:03.261828 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:03.261798 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" event={"ID":"00dff997-07bc-4c63-b807-4d1546d252d3","Type":"ContainerStarted","Data":"048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff"} Jul 08 22:00:03.886949 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:03.886899 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 22:00:03.887975 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:03.887949 2559 patch_prober.go:28] interesting pod/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 08 22:00:03.888042 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:03.888012 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 08 22:00:04.188757 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:04.188727 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 22:00:04.886892 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:04.886859 2559 patch_prober.go:28] interesting pod/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 08 22:00:04.887350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:04.886908 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 08 22:00:05.601188 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:05.601155 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:00:05.887435 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:05.887348 2559 patch_prober.go:28] interesting pod/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 08 22:00:05.887435 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:05.887410 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 08 22:00:06.887928 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:06.887892 2559 patch_prober.go:28] interesting pod/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 08 22:00:06.888327 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:06.887951 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 08 22:00:07.842623 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:07.842591 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g"] Jul 08 22:00:07.842797 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:07.842776 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" containerID="cri-o://048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff" gracePeriod=30 Jul 08 22:00:13.101417 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.101394 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 22:00:13.184865 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.184836 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-istio-token\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185020 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.184899 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-envoy\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185020 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.184941 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-socket\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185020 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.184982 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-credential-socket\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185020 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185007 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbnb9\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-kube-api-access-fbnb9\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185201 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185038 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dff997-07bc-4c63-b807-4d1546d252d3-istio-podinfo\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185201 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185095 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dff997-07bc-4c63-b807-4d1546d252d3-istiod-ca-cert\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185201 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185145 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-certs\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185201 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185171 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-data\") pod \"00dff997-07bc-4c63-b807-4d1546d252d3\" (UID: \"00dff997-07bc-4c63-b807-4d1546d252d3\") " Jul 08 22:00:13.185404 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185240 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:00:13.185473 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185436 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.185473 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185455 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:00:13.185669 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185645 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:00:13.185729 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.185509 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00dff997-07bc-4c63-b807-4d1546d252d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:00:13.186384 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.186356 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:00:13.187061 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.187028 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:00:13.187185 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.187150 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:00:13.187462 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.187438 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00dff997-07bc-4c63-b807-4d1546d252d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:00:13.187544 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.187441 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-kube-api-access-fbnb9" (OuterVolumeSpecName: "kube-api-access-fbnb9") pod "00dff997-07bc-4c63-b807-4d1546d252d3" (UID: "00dff997-07bc-4c63-b807-4d1546d252d3"). InnerVolumeSpecName "kube-api-access-fbnb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:00:13.286048 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.286019 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.286048 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.286046 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.286048 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.286056 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbnb9\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-kube-api-access-fbnb9\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.286278 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.286065 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00dff997-07bc-4c63-b807-4d1546d252d3-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.286278 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.286074 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00dff997-07bc-4c63-b807-4d1546d252d3-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.286278 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.286082 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.286278 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.286090 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00dff997-07bc-4c63-b807-4d1546d252d3-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.286278 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.286096 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00dff997-07bc-4c63-b807-4d1546d252d3-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:00:13.317223 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.317192 2559 generic.go:356] "Generic (PLEG): container finished" podID="00dff997-07bc-4c63-b807-4d1546d252d3" containerID="048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff" exitCode=0 Jul 08 22:00:13.317367 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.317237 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" Jul 08 22:00:13.317367 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.317276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" event={"ID":"00dff997-07bc-4c63-b807-4d1546d252d3","Type":"ContainerDied","Data":"048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff"} Jul 08 22:00:13.317367 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.317329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g" event={"ID":"00dff997-07bc-4c63-b807-4d1546d252d3","Type":"ContainerDied","Data":"6a64eba0bd22304d76f271b955a61e70d130cc22e07f7d0ab415868ca6c561eb"} Jul 08 22:00:13.317367 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.317353 2559 scope.go:117] "RemoveContainer" containerID="048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff" Jul 08 22:00:13.326961 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.326941 2559 scope.go:117] "RemoveContainer" containerID="a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78" Jul 08 22:00:13.334956 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.334937 2559 scope.go:117] "RemoveContainer" containerID="048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff" Jul 08 22:00:13.335203 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:00:13.335183 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff\": container with ID starting with 048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff not found: ID does not exist" containerID="048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff" Jul 08 22:00:13.335430 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.335215 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff"} err="failed to get container status \"048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff\": rpc error: code = NotFound desc = could not find container \"048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff\": container with ID starting with 048607cca13d88387363b3917bfe48efa00ab2734040fb13f519db10dd37e6ff not found: ID does not exist" Jul 08 22:00:13.335430 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.335238 2559 scope.go:117] "RemoveContainer" containerID="a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78" Jul 08 22:00:13.335589 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:00:13.335437 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78\": container with ID starting with a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78 not found: ID does not exist" containerID="a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78" Jul 08 22:00:13.335589 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.335458 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78"} err="failed to get container status \"a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78\": rpc error: code = NotFound desc = could not find container \"a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78\": container with ID starting with a371b9cead8ceb2dc5af30357347613f1f75163e74023db4010d981b73e8fe78 not found: ID does not exist" Jul 08 22:00:13.340776 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.340753 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g"] Jul 08 22:00:13.344504 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.344483 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6c8ebf0a-openshift-default-69f47449f-8b75g"] Jul 08 22:00:13.444377 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:13.444291 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" path="/var/lib/kubelet/pods/00dff997-07bc-4c63-b807-4d1546d252d3/volumes" Jul 08 22:00:27.092049 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.092009 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj"] Jul 08 22:00:27.092435 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.092353 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" Jul 08 22:00:27.092435 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.092364 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" Jul 08 22:00:27.092435 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.092377 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" Jul 08 22:00:27.092435 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.092382 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" Jul 08 22:00:27.092435 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.092436 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" Jul 08 22:00:27.092628 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.092447 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="00dff997-07bc-4c63-b807-4d1546d252d3" containerName="istio-proxy" Jul 08 22:00:27.096683 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.096664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.099048 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.099027 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e7bf8858-openshift-default-dockercfg-dsjjd\"" Jul 08 22:00:27.110688 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.110664 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj"] Jul 08 22:00:27.207392 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl858\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-kube-api-access-pl858\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.207602 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-envoy\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.207602 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-data\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.207602 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207461 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-credential-socket\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.207602 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b015a-d725-488f-b994-90a10207d79e-istio-podinfo\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.207602 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-istio-token\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.207602 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b015a-d725-488f-b994-90a10207d79e-istiod-ca-cert\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.207908 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-socket\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.207908 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.207725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-certs\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.308494 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308460 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl858\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-kube-api-access-pl858\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.308708 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-envoy\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.308708 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-data\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.308708 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-credential-socket\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.308708 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b015a-d725-488f-b994-90a10207d79e-istio-podinfo\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.308708 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-istio-token\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.308708 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b015a-d725-488f-b994-90a10207d79e-istiod-ca-cert\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.309049 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-socket\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.309049 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.308944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-certs\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.309150 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.309079 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-data\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.309201 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.309171 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-credential-socket\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.309264 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.309230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-certs\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.309264 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.309252 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-socket\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.309427 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.309408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b015a-d725-488f-b994-90a10207d79e-istiod-ca-cert\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.310919 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.310896 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-envoy\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.311035 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.311018 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b015a-d725-488f-b994-90a10207d79e-istio-podinfo\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.316932 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.316909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-istio-token\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.317038 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.317015 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl858\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-kube-api-access-pl858\") pod \"e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.406546 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.406433 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:27.545907 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.545870 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj"] Jul 08 22:00:27.548821 ip-10-0-143-77 kubenswrapper[2559]: W0708 22:00:27.548799 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5b015a_d725_488f_b994_90a10207d79e.slice/crio-fc8ef55b10a6c446218d5c36682f49e1c6685b5c52760710a9885544f8222af0 WatchSource:0}: Error finding container fc8ef55b10a6c446218d5c36682f49e1c6685b5c52760710a9885544f8222af0: Status 404 returned error can't find the container with id fc8ef55b10a6c446218d5c36682f49e1c6685b5c52760710a9885544f8222af0 Jul 08 22:00:27.550960 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.550928 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:27.551057 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.550992 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:27.551057 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:27.551024 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:28.389324 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:28.389284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" event={"ID":"8b5b015a-d725-488f-b994-90a10207d79e","Type":"ContainerStarted","Data":"da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784"} Jul 08 22:00:28.389770 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:28.389347 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" event={"ID":"8b5b015a-d725-488f-b994-90a10207d79e","Type":"ContainerStarted","Data":"fc8ef55b10a6c446218d5c36682f49e1c6685b5c52760710a9885544f8222af0"} Jul 08 22:00:28.407036 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:28.407010 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:28.410834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:28.410778 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" podStartSLOduration=1.41075969 podStartE2EDuration="1.41075969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:00:28.408964358 +0000 UTC m=+1645.521959076" watchObservedRunningTime="2026-07-08 22:00:28.41075969 +0000 UTC m=+1645.523754409" Jul 08 22:00:28.412912 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:28.412890 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:29.395339 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:29.395309 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:29.396289 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:29.396271 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:34.805335 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:34.805296 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:00:42.460900 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:42.460869 2559 generic.go:356] "Generic (PLEG): container finished" podID="8b5b015a-d725-488f-b994-90a10207d79e" containerID="da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784" exitCode=0 Jul 08 22:00:42.461351 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:42.460950 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" event={"ID":"8b5b015a-d725-488f-b994-90a10207d79e","Type":"ContainerDied","Data":"da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784"} Jul 08 22:00:42.461351 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:42.461316 2559 scope.go:117] "RemoveContainer" containerID="da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784" Jul 08 22:00:42.462255 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:42.462229 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:42.462319 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:42.462294 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:42.462356 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:42.462324 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:00:43.467642 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:43.467604 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" event={"ID":"8b5b015a-d725-488f-b994-90a10207d79e","Type":"ContainerStarted","Data":"04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f"} Jul 08 22:00:43.811819 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:43.811732 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:00:44.396132 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:44.396092 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:44.407025 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:44.407004 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:44.408113 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:44.408087 2559 patch_prober.go:28] interesting pod/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 08 22:00:44.408211 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:44.408138 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 08 22:00:45.407798 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:45.407763 2559 patch_prober.go:28] interesting pod/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 08 22:00:45.408217 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:45.407818 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 08 22:00:46.407195 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:46.407164 2559 patch_prober.go:28] interesting pod/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 08 22:00:46.407373 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:46.407245 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 08 22:00:47.407850 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:47.407813 2559 patch_prober.go:28] interesting pod/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 08 22:00:47.408259 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:47.407868 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 08 22:00:48.407738 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:48.407694 2559 patch_prober.go:28] interesting pod/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 08 22:00:48.407917 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:48.407761 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 08 22:00:49.410424 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:49.410391 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:00:49.411311 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:00:49.411293 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:01:09.878032 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:01:09.877994 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:01:23.997800 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:01:23.997719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:02:03.110276 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:03.110241 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:02:06.448263 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:06.448227 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj"] Jul 08 22:02:06.448677 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:06.448481 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" containerID="cri-o://04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f" gracePeriod=30 Jul 08 22:02:11.706185 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.706145 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:02:11.745692 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745608 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-credential-socket\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.745692 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745661 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b015a-d725-488f-b994-90a10207d79e-istio-podinfo\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.745692 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745678 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-istio-token\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.745692 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745692 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-socket\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.746036 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745711 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-certs\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.746036 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745761 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-envoy\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.746036 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745795 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b015a-d725-488f-b994-90a10207d79e-istiod-ca-cert\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.746036 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745828 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl858\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-kube-api-access-pl858\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.746036 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745870 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-data\") pod \"8b5b015a-d725-488f-b994-90a10207d79e\" (UID: \"8b5b015a-d725-488f-b994-90a10207d79e\") " Jul 08 22:02:11.746036 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.745889 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:02:11.746036 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.746026 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:02:11.746416 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.746037 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:02:11.746416 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.746190 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.746416 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.746209 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.746416 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.746224 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.746416 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.746269 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b5b015a-d725-488f-b994-90a10207d79e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:02:11.746900 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.746859 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:02:11.748157 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.748131 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-kube-api-access-pl858" (OuterVolumeSpecName: "kube-api-access-pl858") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "kube-api-access-pl858". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:02:11.748260 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.748179 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:02:11.748260 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.748224 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b5b015a-d725-488f-b994-90a10207d79e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:02:11.748378 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.748360 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b5b015a-d725-488f-b994-90a10207d79e" (UID: "8b5b015a-d725-488f-b994-90a10207d79e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:02:11.847012 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.846979 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.847012 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.847008 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b5b015a-d725-488f-b994-90a10207d79e-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.847228 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.847023 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl858\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-kube-api-access-pl858\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.847228 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.847034 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b5b015a-d725-488f-b994-90a10207d79e-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.847228 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.847043 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b5b015a-d725-488f-b994-90a10207d79e-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.847228 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.847050 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b5b015a-d725-488f-b994-90a10207d79e-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:02:11.910489 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.910455 2559 generic.go:356] "Generic (PLEG): container finished" podID="8b5b015a-d725-488f-b994-90a10207d79e" containerID="04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f" exitCode=0 Jul 08 22:02:11.910676 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.910510 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" Jul 08 22:02:11.910676 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.910564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" event={"ID":"8b5b015a-d725-488f-b994-90a10207d79e","Type":"ContainerDied","Data":"04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f"} Jul 08 22:02:11.910676 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.910626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj" event={"ID":"8b5b015a-d725-488f-b994-90a10207d79e","Type":"ContainerDied","Data":"fc8ef55b10a6c446218d5c36682f49e1c6685b5c52760710a9885544f8222af0"} Jul 08 22:02:11.910676 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.910649 2559 scope.go:117] "RemoveContainer" containerID="04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f" Jul 08 22:02:11.920333 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.920314 2559 scope.go:117] "RemoveContainer" containerID="da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784" Jul 08 22:02:11.928727 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.928704 2559 scope.go:117] "RemoveContainer" containerID="04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f" Jul 08 22:02:11.928987 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:02:11.928966 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f\": container with ID starting with 04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f not found: ID does not exist" containerID="04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f" Jul 08 22:02:11.929034 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.928998 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f"} err="failed to get container status \"04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f\": rpc error: code = NotFound desc = could not find container \"04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f\": container with ID starting with 04db21784d95f6e77e32807e5f48997d9efad8d24672cc97dd6226c6695c2a0f not found: ID does not exist" Jul 08 22:02:11.929034 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.929016 2559 scope.go:117] "RemoveContainer" containerID="da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784" Jul 08 22:02:11.929270 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:02:11.929250 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784\": container with ID starting with da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784 not found: ID does not exist" containerID="da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784" Jul 08 22:02:11.929328 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.929276 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784"} err="failed to get container status \"da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784\": rpc error: code = NotFound desc = could not find container \"da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784\": container with ID starting with da6ca96101900301f9d3b259f657336e2b9874bf5f8b1813997dee8facd3f784 not found: ID does not exist" Jul 08 22:02:11.932846 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.932823 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj"] Jul 08 22:02:11.937007 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:11.936985 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e7bf8858-openshift-default-68f7757df5-fc7rj"] Jul 08 22:02:13.444835 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:13.444803 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5b015a-d725-488f-b994-90a10207d79e" path="/var/lib/kubelet/pods/8b5b015a-d725-488f-b994-90a10207d79e/volumes" Jul 08 22:02:14.404889 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:14.404855 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:02:23.623909 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:02:23.623875 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:03:02.407006 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.406969 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj"] Jul 08 22:03:02.408090 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.408063 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" Jul 08 22:03:02.408231 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.408220 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" Jul 08 22:03:02.408321 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.408312 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" Jul 08 22:03:02.408391 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.408383 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" Jul 08 22:03:02.408576 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.408564 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" Jul 08 22:03:02.411967 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.411947 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.416289 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.416271 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0303e4-openshift-default-dockercfg-frjdq\"" Jul 08 22:03:02.425548 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.425508 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj"] Jul 08 22:03:02.488069 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-credential-socket\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.488350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05807ed7-b509-4746-baac-df124270959a-istio-podinfo\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.488473 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-istio-token\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.488555 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05807ed7-b509-4746-baac-df124270959a-istiod-ca-cert\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.488555 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq2gn\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-kube-api-access-vq2gn\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.488677 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-socket\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.488677 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-data\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.488677 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-certs\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.488677 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.488661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-envoy\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.589565 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-socket\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.589792 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-data\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.589792 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-certs\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.589792 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589720 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-envoy\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.589792 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-credential-socket\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.590054 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05807ed7-b509-4746-baac-df124270959a-istio-podinfo\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.590054 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-istio-token\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.590054 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05807ed7-b509-4746-baac-df124270959a-istiod-ca-cert\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.590054 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.589951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq2gn\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-kube-api-access-vq2gn\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.590264 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.590125 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-data\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.590264 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.590142 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-socket\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.590367 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.590340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-credential-socket\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.590872 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.590846 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05807ed7-b509-4746-baac-df124270959a-istiod-ca-cert\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.591050 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.590854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-certs\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.592942 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.592919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-envoy\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.593249 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.593228 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05807ed7-b509-4746-baac-df124270959a-istio-podinfo\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.597932 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.597903 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-istio-token\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.598150 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.598131 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq2gn\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-kube-api-access-vq2gn\") pod \"e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.722484 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.722447 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:02.862373 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.862346 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj"] Jul 08 22:03:02.864302 ip-10-0-143-77 kubenswrapper[2559]: W0708 22:03:02.864272 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05807ed7_b509_4746_baac_df124270959a.slice/crio-a087209998962ef8e3202f53d0f8fd14a689c214bf3a46a3514617fe9defe3e8 WatchSource:0}: Error finding container a087209998962ef8e3202f53d0f8fd14a689c214bf3a46a3514617fe9defe3e8: Status 404 returned error can't find the container with id a087209998962ef8e3202f53d0f8fd14a689c214bf3a46a3514617fe9defe3e8 Jul 08 22:03:02.866414 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.866385 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:02.866468 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.866450 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:02.866503 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:02.866483 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:03.166453 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:03.166366 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" event={"ID":"05807ed7-b509-4746-baac-df124270959a","Type":"ContainerStarted","Data":"e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531"} Jul 08 22:03:03.166453 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:03.166419 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" event={"ID":"05807ed7-b509-4746-baac-df124270959a","Type":"ContainerStarted","Data":"a087209998962ef8e3202f53d0f8fd14a689c214bf3a46a3514617fe9defe3e8"} Jul 08 22:03:03.186719 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:03.186668 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" podStartSLOduration=1.186652225 podStartE2EDuration="1.186652225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:03:03.185105622 +0000 UTC m=+1800.298100340" watchObservedRunningTime="2026-07-08 22:03:03.186652225 +0000 UTC m=+1800.299646942" Jul 08 22:03:03.476308 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:03.476282 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 22:03:03.480788 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:03.480769 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 22:03:03.722791 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:03.722759 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:03.727663 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:03.727591 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:04.171847 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:04.171757 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:04.172740 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:04.172720 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:10.280570 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.280475 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj"] Jul 08 22:03:10.281092 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.281071 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5b015a-d725-488f-b994-90a10207d79e" containerName="istio-proxy" Jul 08 22:03:10.284038 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.284022 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.286867 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.286848 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b6d4ea-openshift-default-dockercfg-tw9vb\"" Jul 08 22:03:10.299669 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.299644 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj"] Jul 08 22:03:10.359122 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-envoy\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.359327 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413d8a46-922c-48f8-928f-8238151bbabf-istiod-ca-cert\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.359327 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-istio-token\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.359327 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-socket\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.359327 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359249 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnph\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-kube-api-access-kjnph\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.359327 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-data\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.359327 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413d8a46-922c-48f8-928f-8238151bbabf-istio-podinfo\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.359686 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-credential-socket\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.359686 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.359423 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-certs\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.460917 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.460862 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413d8a46-922c-48f8-928f-8238151bbabf-istiod-ca-cert\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.460917 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.460922 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-istio-token\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461175 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.460956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-socket\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461175 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.460977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnph\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-kube-api-access-kjnph\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461175 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-data\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461175 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413d8a46-922c-48f8-928f-8238151bbabf-istio-podinfo\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461175 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-credential-socket\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461175 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461157 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-certs\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461473 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-envoy\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461473 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-socket\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461473 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-data\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461660 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-certs\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461706 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461661 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413d8a46-922c-48f8-928f-8238151bbabf-istiod-ca-cert\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.461803 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.461785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-credential-socket\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.463390 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.463369 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-envoy\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.463641 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.463621 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413d8a46-922c-48f8-928f-8238151bbabf-istio-podinfo\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.470002 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.469982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnph\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-kube-api-access-kjnph\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.470091 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.470044 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-istio-token\") pod \"e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.594719 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.594628 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:10.735371 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.735346 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj"] Jul 08 22:03:10.737168 ip-10-0-143-77 kubenswrapper[2559]: W0708 22:03:10.737132 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413d8a46_922c_48f8_928f_8238151bbabf.slice/crio-75af293b82ff2de79dbddce71a9756257b70165deab81133b586ccfa2e8d3c89 WatchSource:0}: Error finding container 75af293b82ff2de79dbddce71a9756257b70165deab81133b586ccfa2e8d3c89: Status 404 returned error can't find the container with id 75af293b82ff2de79dbddce71a9756257b70165deab81133b586ccfa2e8d3c89 Jul 08 22:03:10.739729 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.739701 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:10.739794 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.739765 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:10.739848 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:10.739793 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:11.207160 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:11.207120 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" event={"ID":"413d8a46-922c-48f8-928f-8238151bbabf","Type":"ContainerStarted","Data":"80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303"} Jul 08 22:03:11.207336 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:11.207189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" event={"ID":"413d8a46-922c-48f8-928f-8238151bbabf","Type":"ContainerStarted","Data":"75af293b82ff2de79dbddce71a9756257b70165deab81133b586ccfa2e8d3c89"} Jul 08 22:03:11.228168 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:11.228116 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" podStartSLOduration=1.228100203 podStartE2EDuration="1.228100203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:03:11.225668434 +0000 UTC m=+1808.338663165" watchObservedRunningTime="2026-07-08 22:03:11.228100203 +0000 UTC m=+1808.341094923" Jul 08 22:03:11.595675 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:11.595576 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:11.600294 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:11.600267 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:12.213430 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:12.213399 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:12.214512 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:12.214492 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:13.124103 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:13.124069 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:03:20.214682 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:20.214644 2559 patch_prober.go:28] interesting pod/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 22:03:20.215074 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:20.214702 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 22:03:21.273777 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:21.273684 2559 generic.go:356] "Generic (PLEG): container finished" podID="05807ed7-b509-4746-baac-df124270959a" containerID="e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531" exitCode=0 Jul 08 22:03:21.273777 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:21.273759 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" event={"ID":"05807ed7-b509-4746-baac-df124270959a","Type":"ContainerDied","Data":"e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531"} Jul 08 22:03:21.274260 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:21.274176 2559 scope.go:117] "RemoveContainer" containerID="e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531" Jul 08 22:03:21.275211 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:21.275182 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:21.275276 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:21.275256 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:21.275360 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:21.275295 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:22.280710 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:22.280673 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" event={"ID":"05807ed7-b509-4746-baac-df124270959a","Type":"ContainerStarted","Data":"2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a"} Jul 08 22:03:22.723247 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:22.723161 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:22.723453 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:22.723417 2559 patch_prober.go:28] interesting pod/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 08 22:03:22.723564 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:22.723488 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 08 22:03:23.723466 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:23.723412 2559 patch_prober.go:28] interesting pod/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 08 22:03:23.723902 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:23.723482 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 08 22:03:24.497066 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:24.497012 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:03:24.723217 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:24.723186 2559 patch_prober.go:28] interesting pod/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 08 22:03:24.723404 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:24.723236 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 08 22:03:25.723386 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:25.723341 2559 patch_prober.go:28] interesting pod/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 08 22:03:25.723815 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:25.723415 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 08 22:03:26.726225 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:26.726191 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:26.726654 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:26.726555 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:26.727229 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:26.727212 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:03:28.110643 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:28.109560 2559 patch_prober.go:28] interesting pod/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": read tcp 10.134.0.2:60354->10.134.0.40:15021: read: connection reset by peer" start-of-body= Jul 08 22:03:28.110643 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:28.109628 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": read tcp 10.134.0.2:60354->10.134.0.40:15021: read: connection reset by peer" Jul 08 22:03:28.319565 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:28.319463 2559 generic.go:356] "Generic (PLEG): container finished" podID="413d8a46-922c-48f8-928f-8238151bbabf" containerID="80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303" exitCode=0 Jul 08 22:03:28.319725 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:28.319553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" event={"ID":"413d8a46-922c-48f8-928f-8238151bbabf","Type":"ContainerDied","Data":"80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303"} Jul 08 22:03:28.320056 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:28.320041 2559 scope.go:117] "RemoveContainer" containerID="80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303" Jul 08 22:03:28.321000 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:28.320977 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:28.321074 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:28.321060 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:28.321117 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:28.321105 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:03:29.326652 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:29.326610 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" event={"ID":"413d8a46-922c-48f8-928f-8238151bbabf","Type":"ContainerStarted","Data":"aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f"} Jul 08 22:03:29.595838 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:29.595742 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:29.596039 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:29.596012 2559 patch_prober.go:28] interesting pod/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 08 22:03:29.596121 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:29.596084 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 08 22:03:30.595742 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:30.595705 2559 patch_prober.go:28] interesting pod/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 08 22:03:30.596117 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:30.595784 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 08 22:03:31.595970 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:31.595930 2559 patch_prober.go:28] interesting pod/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 08 22:03:31.596352 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:31.596004 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 08 22:03:32.595324 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:32.595281 2559 patch_prober.go:28] interesting pod/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 08 22:03:32.595542 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:32.595344 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 08 22:03:33.598725 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:33.598696 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:33.599224 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:33.598957 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:33.599614 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:33.599597 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:03:36.609707 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:36.609673 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:03:53.508071 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:03:53.508033 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:04:11.598664 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:11.598627 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:04:49.373741 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:49.373656 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj"] Jul 08 22:04:49.374325 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:49.373876 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" containerID="cri-o://2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a" gracePeriod=30 Jul 08 22:04:53.592868 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:53.592833 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:04:54.627484 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.627454 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:04:54.728045 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728015 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05807ed7-b509-4746-baac-df124270959a-istio-podinfo\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728219 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728070 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-envoy\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728219 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728100 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-credential-socket\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728219 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728129 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-istio-token\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728219 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728147 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-certs\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728219 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728182 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq2gn\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-kube-api-access-vq2gn\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728219 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728210 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05807ed7-b509-4746-baac-df124270959a-istiod-ca-cert\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728557 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728250 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-data\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728557 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728319 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-socket\") pod \"05807ed7-b509-4746-baac-df124270959a\" (UID: \"05807ed7-b509-4746-baac-df124270959a\") " Jul 08 22:04:54.728557 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728498 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:04:54.728730 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728642 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:54.728730 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728637 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05807ed7-b509-4746-baac-df124270959a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:04:54.728838 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728728 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:04:54.728838 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.728747 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:04:54.729331 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.729312 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-data" (OuterVolumeSpecName: "istio-data") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:04:54.730820 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.730792 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05807ed7-b509-4746-baac-df124270959a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:04:54.730923 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.730791 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-kube-api-access-vq2gn" (OuterVolumeSpecName: "kube-api-access-vq2gn") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "kube-api-access-vq2gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:04:54.730923 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.730837 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:04:54.730923 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.730854 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-istio-token" (OuterVolumeSpecName: "istio-token") pod "05807ed7-b509-4746-baac-df124270959a" (UID: "05807ed7-b509-4746-baac-df124270959a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:04:54.772644 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.772607 2559 generic.go:356] "Generic (PLEG): container finished" podID="05807ed7-b509-4746-baac-df124270959a" containerID="2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a" exitCode=0 Jul 08 22:04:54.772776 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.772651 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" Jul 08 22:04:54.772776 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.772662 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" event={"ID":"05807ed7-b509-4746-baac-df124270959a","Type":"ContainerDied","Data":"2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a"} Jul 08 22:04:54.772776 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.772713 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj" event={"ID":"05807ed7-b509-4746-baac-df124270959a","Type":"ContainerDied","Data":"a087209998962ef8e3202f53d0f8fd14a689c214bf3a46a3514617fe9defe3e8"} Jul 08 22:04:54.772776 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.772737 2559 scope.go:117] "RemoveContainer" containerID="2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a" Jul 08 22:04:54.781673 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.781658 2559 scope.go:117] "RemoveContainer" containerID="e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531" Jul 08 22:04:54.789483 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.789465 2559 scope.go:117] "RemoveContainer" containerID="2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a" Jul 08 22:04:54.789752 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:04:54.789732 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a\": container with ID starting with 2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a not found: ID does not exist" containerID="2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a" Jul 08 22:04:54.789815 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.789760 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a"} err="failed to get container status \"2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a\": rpc error: code = NotFound desc = could not find container \"2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a\": container with ID starting with 2b058312fc06545846ea7db35d9b3b998850247562cd0886ec8ad928ae2a859a not found: ID does not exist" Jul 08 22:04:54.789815 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.789778 2559 scope.go:117] "RemoveContainer" containerID="e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531" Jul 08 22:04:54.789999 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:04:54.789984 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531\": container with ID starting with e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531 not found: ID does not exist" containerID="e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531" Jul 08 22:04:54.790039 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.790004 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531"} err="failed to get container status \"e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531\": rpc error: code = NotFound desc = could not find container \"e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531\": container with ID starting with e4c800a6790047f425bfee8226eaa3531cb49552512311024224ec25d83a5531 not found: ID does not exist" Jul 08 22:04:54.794547 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.794509 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj"] Jul 08 22:04:54.800432 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.800412 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0303e4-openshift-default-54568c86c9-b4fvj"] Jul 08 22:04:54.829621 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.829598 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:54.829621 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.829618 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05807ed7-b509-4746-baac-df124270959a-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:54.829753 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.829629 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:54.829753 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.829636 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:54.829753 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.829646 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:54.829753 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.829655 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq2gn\" (UniqueName: \"kubernetes.io/projected/05807ed7-b509-4746-baac-df124270959a-kube-api-access-vq2gn\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:54.829753 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.829664 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05807ed7-b509-4746-baac-df124270959a-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:54.829753 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:54.829674 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05807ed7-b509-4746-baac-df124270959a-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:04:55.443910 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:55.443880 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05807ed7-b509-4746-baac-df124270959a" path="/var/lib/kubelet/pods/05807ed7-b509-4746-baac-df124270959a/volumes" Jul 08 22:04:56.082441 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.082401 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj"] Jul 08 22:04:56.082839 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.082711 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" containerID="cri-o://aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f" gracePeriod=30 Jul 08 22:04:56.954744 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.954706 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4"] Jul 08 22:04:56.955205 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.955191 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" Jul 08 22:04:56.955259 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.955209 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" Jul 08 22:04:56.955259 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.955232 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" Jul 08 22:04:56.955259 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.955241 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" Jul 08 22:04:56.955360 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.955314 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" Jul 08 22:04:56.955360 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.955327 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05807ed7-b509-4746-baac-df124270959a" containerName="istio-proxy" Jul 08 22:04:56.960123 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.960105 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:56.962480 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.962459 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c32bb0-openshift-default-dockercfg-hp68l\"" Jul 08 22:04:56.970930 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:56.970909 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4"] Jul 08 22:04:57.050226 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-certs\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.050479 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-envoy\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.050479 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-podinfo\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.050479 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-socket\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.050479 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-token\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.050814 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-credential-socket\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.050814 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhq8n\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-kube-api-access-qhq8n\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.050814 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050626 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-data\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.050814 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.050653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istiod-ca-cert\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151330 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151288 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-socket\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-token\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151418 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-credential-socket\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhq8n\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-kube-api-access-qhq8n\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151490 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-data\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istiod-ca-cert\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-certs\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-envoy\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.151834 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.151658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-podinfo\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.152271 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.152208 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-credential-socket\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.152271 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.152234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-certs\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.152642 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.152615 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-data\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.152831 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.152621 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-socket\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.152986 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.152858 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istiod-ca-cert\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.154365 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.154345 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-envoy\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.154634 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.154617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-podinfo\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.159653 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.159632 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhq8n\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-kube-api-access-qhq8n\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.160944 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.160918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-token\") pod \"e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.271240 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.271145 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:57.409885 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.409859 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4"] Jul 08 22:04:57.412123 ip-10-0-143-77 kubenswrapper[2559]: W0708 22:04:57.412099 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abfb97d_6e5d_4ec3_8ad2_687c7d9164a6.slice/crio-02b8f2c3b77939480fcc0d107f28f16cd9e2953d27ef315417da78141646b2d6 WatchSource:0}: Error finding container 02b8f2c3b77939480fcc0d107f28f16cd9e2953d27ef315417da78141646b2d6: Status 404 returned error can't find the container with id 02b8f2c3b77939480fcc0d107f28f16cd9e2953d27ef315417da78141646b2d6 Jul 08 22:04:57.414674 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.414646 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:04:57.414733 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.414710 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:04:57.414809 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.414738 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:04:57.792593 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.792543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" event={"ID":"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6","Type":"ContainerStarted","Data":"593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81"} Jul 08 22:04:57.792593 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.792608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" event={"ID":"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6","Type":"ContainerStarted","Data":"02b8f2c3b77939480fcc0d107f28f16cd9e2953d27ef315417da78141646b2d6"} Jul 08 22:04:57.814947 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:57.814896 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" podStartSLOduration=1.814880777 podStartE2EDuration="1.814880777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:04:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:04:57.813374556 +0000 UTC m=+1914.926369286" watchObservedRunningTime="2026-07-08 22:04:57.814880777 +0000 UTC m=+1914.927875495" Jul 08 22:04:58.271500 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:58.271459 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:58.276990 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:58.276964 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:58.798079 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:58.798049 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:04:58.798996 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:04:58.798973 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:05:01.342121 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.342092 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:05:01.493447 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493413 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-socket\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.493675 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493458 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-envoy\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.493675 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493485 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-data\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.493675 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493507 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-credential-socket\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.493675 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493615 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-istio-token\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.493675 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493645 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjnph\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-kube-api-access-kjnph\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.493675 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493669 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413d8a46-922c-48f8-928f-8238151bbabf-istio-podinfo\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.494021 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493756 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:01.494021 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493766 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-certs\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.494021 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493812 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413d8a46-922c-48f8-928f-8238151bbabf-istiod-ca-cert\") pod \"413d8a46-922c-48f8-928f-8238151bbabf\" (UID: \"413d8a46-922c-48f8-928f-8238151bbabf\") " Jul 08 22:05:01.494021 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493954 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:01.494021 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.493998 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:01.494271 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.494221 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.494271 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.494231 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413d8a46-922c-48f8-928f-8238151bbabf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:05:01.494271 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.494241 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.494422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.494273 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.494422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.494378 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-data" (OuterVolumeSpecName: "istio-data") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:01.495893 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.495865 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:01.495893 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.495875 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-istio-token" (OuterVolumeSpecName: "istio-token") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:05:01.496254 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.496236 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/413d8a46-922c-48f8-928f-8238151bbabf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:05:01.496299 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.496257 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-kube-api-access-kjnph" (OuterVolumeSpecName: "kube-api-access-kjnph") pod "413d8a46-922c-48f8-928f-8238151bbabf" (UID: "413d8a46-922c-48f8-928f-8238151bbabf"). InnerVolumeSpecName "kube-api-access-kjnph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:05:01.595698 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.595663 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.595698 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.595691 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/413d8a46-922c-48f8-928f-8238151bbabf-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.595698 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.595700 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.595945 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.595711 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjnph\" (UniqueName: \"kubernetes.io/projected/413d8a46-922c-48f8-928f-8238151bbabf-kube-api-access-kjnph\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.595945 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.595720 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/413d8a46-922c-48f8-928f-8238151bbabf-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.595945 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.595728 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/413d8a46-922c-48f8-928f-8238151bbabf-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:01.800437 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.800341 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:05:01.815243 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.815212 2559 generic.go:356] "Generic (PLEG): container finished" podID="413d8a46-922c-48f8-928f-8238151bbabf" containerID="aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f" exitCode=0 Jul 08 22:05:01.815440 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.815265 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" Jul 08 22:05:01.815440 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.815273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" event={"ID":"413d8a46-922c-48f8-928f-8238151bbabf","Type":"ContainerDied","Data":"aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f"} Jul 08 22:05:01.815440 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.815324 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj" event={"ID":"413d8a46-922c-48f8-928f-8238151bbabf","Type":"ContainerDied","Data":"75af293b82ff2de79dbddce71a9756257b70165deab81133b586ccfa2e8d3c89"} Jul 08 22:05:01.815440 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.815354 2559 scope.go:117] "RemoveContainer" containerID="aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f" Jul 08 22:05:01.826300 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.826279 2559 scope.go:117] "RemoveContainer" containerID="80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303" Jul 08 22:05:01.834850 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.834829 2559 scope.go:117] "RemoveContainer" containerID="aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f" Jul 08 22:05:01.835121 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:05:01.835101 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f\": container with ID starting with aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f not found: ID does not exist" containerID="aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f" Jul 08 22:05:01.835186 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.835129 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f"} err="failed to get container status \"aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f\": rpc error: code = NotFound desc = could not find container \"aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f\": container with ID starting with aa5ee7227cbcbda72cbf9e6858504b6a04e73ff4dcdf388187f3a534bae5158f not found: ID does not exist" Jul 08 22:05:01.835186 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.835148 2559 scope.go:117] "RemoveContainer" containerID="80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303" Jul 08 22:05:01.835380 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:05:01.835362 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303\": container with ID starting with 80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303 not found: ID does not exist" containerID="80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303" Jul 08 22:05:01.835422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.835386 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303"} err="failed to get container status \"80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303\": rpc error: code = NotFound desc = could not find container \"80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303\": container with ID starting with 80ee58661a5d9723ff2cea434fa3d0b986f589afbea4d3e241c62605e500f303 not found: ID does not exist" Jul 08 22:05:01.842103 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.842078 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj"] Jul 08 22:05:01.845885 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:01.845863 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b6d4ea-openshift-default-6589b7f5d7-tbmgj"] Jul 08 22:05:03.444816 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:03.444785 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413d8a46-922c-48f8-928f-8238151bbabf" path="/var/lib/kubelet/pods/413d8a46-922c-48f8-928f-8238151bbabf/volumes" Jul 08 22:05:04.946108 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:04.946032 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s"] Jul 08 22:05:04.946645 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:04.946399 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" Jul 08 22:05:04.946645 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:04.946411 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" Jul 08 22:05:04.946645 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:04.946469 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" Jul 08 22:05:04.966774 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:04.966740 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s"] Jul 08 22:05:04.967125 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:04.967105 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:04.973841 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:04.973811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-dc88f4-openshift-default-dockercfg-khmwx\"" Jul 08 22:05:05.126706 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqq8v\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-kube-api-access-qqq8v\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.126925 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-data\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.126925 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-envoy\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.126925 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-socket\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.126925 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-certs\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.126925 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-token\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.126925 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-podinfo\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.127180 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-credential-socket\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.127180 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.126980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istiod-ca-cert\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228131 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-podinfo\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228131 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-credential-socket\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228131 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istiod-ca-cert\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228425 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqq8v\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-kube-api-access-qqq8v\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228425 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-data\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228425 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228184 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-envoy\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228425 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-socket\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228425 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228240 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-certs\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228425 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-token\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228709 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228563 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-credential-socket\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228709 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-data\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228779 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-socket\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.228820 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.228776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-certs\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.229047 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.229014 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istiod-ca-cert\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.230574 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.230552 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-envoy\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.230809 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.230790 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-podinfo\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.236006 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.235971 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-token\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.236205 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.236182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqq8v\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-kube-api-access-qqq8v\") pod \"e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.292808 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.292750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:05.468765 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.447455 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s"] Jul 08 22:05:05.473466 ip-10-0-143-77 kubenswrapper[2559]: W0708 22:05:05.473437 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7001ea_00f4_4a47_8c24_222e3632a0d4.slice/crio-1f44dac9fa924eba33c6bfa583249aa759c5eab0ed90c4354c876e733f75d1ad WatchSource:0}: Error finding container 1f44dac9fa924eba33c6bfa583249aa759c5eab0ed90c4354c876e733f75d1ad: Status 404 returned error can't find the container with id 1f44dac9fa924eba33c6bfa583249aa759c5eab0ed90c4354c876e733f75d1ad Jul 08 22:05:05.476272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.476236 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:05.476358 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.476310 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:05.476358 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.476338 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:05.838641 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.838543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" event={"ID":"6d7001ea-00f4-4a47-8c24-222e3632a0d4","Type":"ContainerStarted","Data":"984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6"} Jul 08 22:05:05.838641 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.838595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" event={"ID":"6d7001ea-00f4-4a47-8c24-222e3632a0d4","Type":"ContainerStarted","Data":"1f44dac9fa924eba33c6bfa583249aa759c5eab0ed90c4354c876e733f75d1ad"} Jul 08 22:05:05.861275 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:05.861210 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" podStartSLOduration=1.8611867549999999 podStartE2EDuration="1.861186755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:05:05.858409143 +0000 UTC m=+1922.971403898" watchObservedRunningTime="2026-07-08 22:05:05.861186755 +0000 UTC m=+1922.974181473" Jul 08 22:05:06.292913 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:06.292871 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:06.297944 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:06.297918 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:06.843889 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:06.843855 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:06.844741 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:06.844719 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:10.866138 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:10.866045 2559 generic.go:356] "Generic (PLEG): container finished" podID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerID="593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81" exitCode=0 Jul 08 22:05:10.866138 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:10.866103 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" event={"ID":"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6","Type":"ContainerDied","Data":"593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81"} Jul 08 22:05:10.866746 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:10.866617 2559 scope.go:117] "RemoveContainer" containerID="593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81" Jul 08 22:05:10.867678 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:10.867651 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:10.867755 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:10.867722 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:10.867793 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:10.867755 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:11.875157 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:11.875122 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" event={"ID":"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6","Type":"ContainerStarted","Data":"47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4"} Jul 08 22:05:12.271594 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:12.271549 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:05:12.272762 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:12.272737 2559 patch_prober.go:28] interesting pod/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 08 22:05:12.272863 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:12.272793 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 08 22:05:13.271620 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:13.271568 2559 patch_prober.go:28] interesting pod/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 08 22:05:13.272159 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:13.271638 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 08 22:05:13.798359 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:13.798315 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:05:14.272433 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:14.272397 2559 patch_prober.go:28] interesting pod/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 08 22:05:14.272877 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:14.272470 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 08 22:05:15.271777 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:15.271737 2559 patch_prober.go:28] interesting pod/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 08 22:05:15.271955 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:15.271811 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 08 22:05:15.400465 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:15.400428 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:05:16.276495 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:16.276460 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:05:16.277351 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:16.277330 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:05:22.885686 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:22.885641 2559 patch_prober.go:28] interesting pod/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 22:05:22.886185 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:22.885725 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 22:05:23.937755 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:23.937722 2559 generic.go:356] "Generic (PLEG): container finished" podID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerID="984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6" exitCode=0 Jul 08 22:05:23.938172 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:23.937787 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" event={"ID":"6d7001ea-00f4-4a47-8c24-222e3632a0d4","Type":"ContainerDied","Data":"984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6"} Jul 08 22:05:23.938172 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:23.938146 2559 scope.go:117] "RemoveContainer" containerID="984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6" Jul 08 22:05:23.939203 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:23.939174 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:23.939307 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:23.939256 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:23.939307 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:23.939300 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:24.944582 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:24.944548 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" event={"ID":"6d7001ea-00f4-4a47-8c24-222e3632a0d4","Type":"ContainerStarted","Data":"db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e"} Jul 08 22:05:25.293173 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:25.293083 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:25.293359 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:25.293332 2559 patch_prober.go:28] interesting pod/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 08 22:05:25.293441 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:25.293391 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 08 22:05:26.293295 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:26.293260 2559 patch_prober.go:28] interesting pod/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 08 22:05:26.293732 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:26.293326 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 08 22:05:26.967575 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:26.967513 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4"] Jul 08 22:05:26.967870 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:26.967840 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" containerID="cri-o://47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4" gracePeriod=30 Jul 08 22:05:27.294076 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:27.293990 2559 patch_prober.go:28] interesting pod/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 08 22:05:27.294076 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:27.294063 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 08 22:05:28.293332 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:28.293301 2559 patch_prober.go:28] interesting pod/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 08 22:05:28.293509 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:28.293359 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 08 22:05:29.296885 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:29.296853 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:29.297279 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:29.297181 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:29.297799 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:29.297781 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:31.279606 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:31.279562 2559 patch_prober.go:28] interesting pod/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 08 22:05:31.280029 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:31.279633 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 22:05:31.801201 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:31.801158 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:05:32.224484 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.224460 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:05:32.277214 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277175 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-podinfo\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277230 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-certs\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277268 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-envoy\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277292 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-data\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277332 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-socket\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277367 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istiod-ca-cert\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277422 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277403 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhq8n\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-kube-api-access-qhq8n\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277815 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277437 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-credential-socket\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277815 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277466 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-token\") pod \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\" (UID: \"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6\") " Jul 08 22:05:32.277815 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277583 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:32.277970 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277913 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:32.277970 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.277918 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:32.278365 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.278341 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:32.278564 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.278512 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:05:32.279558 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.279504 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:32.279927 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.279889 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-kube-api-access-qhq8n" (OuterVolumeSpecName: "kube-api-access-qhq8n") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "kube-api-access-qhq8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:05:32.280299 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.279971 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:05:32.280299 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.280287 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:05:32.280412 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.280324 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" (UID: "1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:32.379272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.379184 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:32.379272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.379217 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhq8n\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-kube-api-access-qhq8n\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:32.379272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.379227 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:32.379272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.379236 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:32.379272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.379244 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:32.379272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.379252 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:32.379272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.379259 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:32.379272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:32.379266 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:33.002848 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.002814 2559 generic.go:356] "Generic (PLEG): container finished" podID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerID="47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4" exitCode=0 Jul 08 22:05:33.003027 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.002872 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" Jul 08 22:05:33.003027 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.002891 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" event={"ID":"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6","Type":"ContainerDied","Data":"47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4"} Jul 08 22:05:33.003027 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.002952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4" event={"ID":"1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6","Type":"ContainerDied","Data":"02b8f2c3b77939480fcc0d107f28f16cd9e2953d27ef315417da78141646b2d6"} Jul 08 22:05:33.003027 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.002983 2559 scope.go:117] "RemoveContainer" containerID="47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4" Jul 08 22:05:33.011950 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.011935 2559 scope.go:117] "RemoveContainer" containerID="593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81" Jul 08 22:05:33.019587 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.019571 2559 scope.go:117] "RemoveContainer" containerID="47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4" Jul 08 22:05:33.019836 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:05:33.019817 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4\": container with ID starting with 47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4 not found: ID does not exist" containerID="47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4" Jul 08 22:05:33.019898 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.019844 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4"} err="failed to get container status \"47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4\": rpc error: code = NotFound desc = could not find container \"47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4\": container with ID starting with 47d3957e625c9621c5065588aef00093013cb2e4f926499b0fbe2c25a7ace3f4 not found: ID does not exist" Jul 08 22:05:33.019898 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.019861 2559 scope.go:117] "RemoveContainer" containerID="593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81" Jul 08 22:05:33.020104 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:05:33.020084 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81\": container with ID starting with 593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81 not found: ID does not exist" containerID="593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81" Jul 08 22:05:33.020144 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.020109 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81"} err="failed to get container status \"593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81\": rpc error: code = NotFound desc = could not find container \"593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81\": container with ID starting with 593f9f15e1603b22f1cc56cfe4dd3752fc44523e832f7058438c96ae46f54c81 not found: ID does not exist" Jul 08 22:05:33.023483 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.023463 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4"] Jul 08 22:05:33.027884 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.027861 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c32bb0-openshift-default-6c8d7bb755-d6qh4"] Jul 08 22:05:33.446136 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.446105 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" path="/var/lib/kubelet/pods/1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6/volumes" Jul 08 22:05:33.760746 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.760645 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s"] Jul 08 22:05:33.760920 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:33.760861 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" containerID="cri-o://db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e" gracePeriod=30 Jul 08 22:05:34.634733 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.634698 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz"] Jul 08 22:05:34.635145 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.635042 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" Jul 08 22:05:34.635145 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.635053 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" Jul 08 22:05:34.635145 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.635062 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" Jul 08 22:05:34.635145 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.635069 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" Jul 08 22:05:34.635145 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.635082 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" Jul 08 22:05:34.635145 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.635088 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" Jul 08 22:05:34.635145 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.635141 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" Jul 08 22:05:34.635145 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.635150 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="413d8a46-922c-48f8-928f-8238151bbabf" containerName="istio-proxy" Jul 08 22:05:34.639619 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.639602 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.642054 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.642032 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-074c17-openshift-default-dockercfg-8jjlx\"" Jul 08 22:05:34.648973 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.648943 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz"] Jul 08 22:05:34.700964 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.700931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-credential-socket\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.701165 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.700969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-podinfo\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.701165 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.701003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-certs\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.701165 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.701071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-envoy\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.701165 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.701155 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-token\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.701430 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.701184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-socket\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.701430 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.701215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zqv\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-kube-api-access-v2zqv\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.701430 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.701281 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-data\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.701430 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.701338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istiod-ca-cert\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802359 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istiod-ca-cert\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802604 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-credential-socket\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802604 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-podinfo\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802604 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-certs\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802604 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-envoy\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802604 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-token\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802604 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-socket\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802936 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802620 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zqv\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-kube-api-access-v2zqv\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802936 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-data\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.802936 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-certs\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.803075 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.802958 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-credential-socket\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.803147 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.803126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-data\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.803200 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.803177 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-socket\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.803237 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.803198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istiod-ca-cert\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.804910 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.804886 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-envoy\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.805021 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.804991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-podinfo\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.811600 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.811576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-token\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.811717 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.811595 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zqv\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-kube-api-access-v2zqv\") pod \"e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:34.951374 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:34.951340 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:35.089272 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:35.089242 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz"] Jul 08 22:05:35.090929 ip-10-0-143-77 kubenswrapper[2559]: W0708 22:05:35.090896 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1d7baf_c0a6_41a1_a311_fbee18c333fa.slice/crio-d57f2d814802d62c29cf7d8ed7f7f0beb5116df1c3d0e2b553c6724a67d9661e WatchSource:0}: Error finding container d57f2d814802d62c29cf7d8ed7f7f0beb5116df1c3d0e2b553c6724a67d9661e: Status 404 returned error can't find the container with id d57f2d814802d62c29cf7d8ed7f7f0beb5116df1c3d0e2b553c6724a67d9661e Jul 08 22:05:35.093180 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:35.093143 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:35.093249 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:35.093212 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:35.093249 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:35.093241 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:36.022251 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:36.022210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" event={"ID":"1d1d7baf-c0a6-41a1-a311-fbee18c333fa","Type":"ContainerStarted","Data":"d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7"} Jul 08 22:05:36.022703 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:36.022272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" event={"ID":"1d1d7baf-c0a6-41a1-a311-fbee18c333fa","Type":"ContainerStarted","Data":"d57f2d814802d62c29cf7d8ed7f7f0beb5116df1c3d0e2b553c6724a67d9661e"} Jul 08 22:05:36.042665 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:36.042623 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" podStartSLOduration=2.042603088 podStartE2EDuration="2.042603088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:05:36.041693468 +0000 UTC m=+1953.154688222" watchObservedRunningTime="2026-07-08 22:05:36.042603088 +0000 UTC m=+1953.155597809" Jul 08 22:05:36.951938 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:36.951892 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:36.957207 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:36.957181 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:37.026913 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:37.026881 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:37.027869 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:37.027842 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:39.011171 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.011144 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:39.041271 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.041188 2559 generic.go:356] "Generic (PLEG): container finished" podID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerID="db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e" exitCode=0 Jul 08 22:05:39.041271 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.041235 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" Jul 08 22:05:39.041447 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.041292 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" event={"ID":"6d7001ea-00f4-4a47-8c24-222e3632a0d4","Type":"ContainerDied","Data":"db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e"} Jul 08 22:05:39.041447 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.041345 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s" event={"ID":"6d7001ea-00f4-4a47-8c24-222e3632a0d4","Type":"ContainerDied","Data":"1f44dac9fa924eba33c6bfa583249aa759c5eab0ed90c4354c876e733f75d1ad"} Jul 08 22:05:39.041447 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.041374 2559 scope.go:117] "RemoveContainer" containerID="db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e" Jul 08 22:05:39.050434 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.050412 2559 scope.go:117] "RemoveContainer" containerID="984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6" Jul 08 22:05:39.053750 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.053727 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqq8v\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-kube-api-access-qqq8v\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.053911 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.053768 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-socket\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.053911 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.053796 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istiod-ca-cert\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.053911 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.053839 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-credential-socket\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.053911 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.053890 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-envoy\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.054146 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.053916 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-certs\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.054146 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.053969 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-podinfo\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.054146 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.054028 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-data\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.054146 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.054091 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-token\") pod \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\" (UID: \"6d7001ea-00f4-4a47-8c24-222e3632a0d4\") " Jul 08 22:05:39.054351 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.054273 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:39.054504 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.054419 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.054504 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.054279 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:05:39.054504 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.054483 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:39.054847 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.054799 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:39.055089 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.055069 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:39.056575 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.056552 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:05:39.056660 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.056641 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-kube-api-access-qqq8v" (OuterVolumeSpecName: "kube-api-access-qqq8v") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "kube-api-access-qqq8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:05:39.056792 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.056769 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:05:39.056792 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.056786 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d7001ea-00f4-4a47-8c24-222e3632a0d4" (UID: "6d7001ea-00f4-4a47-8c24-222e3632a0d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:05:39.059582 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.059512 2559 scope.go:117] "RemoveContainer" containerID="db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e" Jul 08 22:05:39.059882 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:05:39.059855 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e\": container with ID starting with db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e not found: ID does not exist" containerID="db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e" Jul 08 22:05:39.059942 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.059885 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e"} err="failed to get container status \"db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e\": rpc error: code = NotFound desc = could not find container \"db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e\": container with ID starting with db7ef2c07544891a69800db29323b72ee4491ace964f46451508723e402b141e not found: ID does not exist" Jul 08 22:05:39.059942 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.059915 2559 scope.go:117] "RemoveContainer" containerID="984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6" Jul 08 22:05:39.060167 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:05:39.060151 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6\": container with ID starting with 984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6 not found: ID does not exist" containerID="984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6" Jul 08 22:05:39.060220 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.060170 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6"} err="failed to get container status \"984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6\": rpc error: code = NotFound desc = could not find container \"984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6\": container with ID starting with 984bbbbb3cafc2c04296fc0fb8a7f2549b4fcd068f16cb4094fc1e8065c378f6 not found: ID does not exist" Jul 08 22:05:39.155468 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.155422 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.155468 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.155463 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.155468 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.155476 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqq8v\" (UniqueName: \"kubernetes.io/projected/6d7001ea-00f4-4a47-8c24-222e3632a0d4-kube-api-access-qqq8v\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.155734 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.155490 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.155734 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.155506 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.155734 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.155548 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.155734 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.155561 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.155734 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.155575 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d7001ea-00f4-4a47-8c24-222e3632a0d4-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:05:39.365863 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.365825 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s"] Jul 08 22:05:39.370392 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.370366 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-dc88f4-openshift-default-6849878c5-q5h9s"] Jul 08 22:05:39.444490 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:39.444458 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" path="/var/lib/kubelet/pods/6d7001ea-00f4-4a47-8c24-222e3632a0d4/volumes" Jul 08 22:05:43.289606 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.289575 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n"] Jul 08 22:05:43.289994 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.289895 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" Jul 08 22:05:43.289994 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.289906 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" Jul 08 22:05:43.289994 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.289972 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" Jul 08 22:05:43.289994 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.289979 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" Jul 08 22:05:43.289994 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.289987 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1abfb97d-6e5d-4ec3-8ad2-687c7d9164a6" containerName="istio-proxy" Jul 08 22:05:43.296725 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.296470 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.299939 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.299910 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-4df112-openshift-default-dockercfg-fgztm\"" Jul 08 22:05:43.317921 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.317891 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n"] Jul 08 22:05:43.321224 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.321200 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:05:43.388507 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-certs\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.388737 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388509 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-credential-socket\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.388737 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388607 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-data\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.388737 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388632 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-token\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.388737 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-socket\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.388737 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-envoy\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.389014 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e177e2c-92ce-4a28-b028-df2e06da7613-istiod-ca-cert\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.389014 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388773 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4hgl\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-kube-api-access-q4hgl\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.389014 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.388807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-podinfo\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.489676 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.489637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-socket\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.489893 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.489698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-envoy\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.489893 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.489831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e177e2c-92ce-4a28-b028-df2e06da7613-istiod-ca-cert\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.489893 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.489866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4hgl\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-kube-api-access-q4hgl\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.489893 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.489889 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-podinfo\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490123 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.489949 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-certs\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490123 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.489975 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-credential-socket\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490123 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.490042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-data\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490123 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.490068 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-token\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490123 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.490097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-socket\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490371 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.490280 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-certs\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490371 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.490359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-credential-socket\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490506 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.490485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-data\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.490581 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.490555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e177e2c-92ce-4a28-b028-df2e06da7613-istiod-ca-cert\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.492104 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.492073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-envoy\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.492351 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.492332 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-podinfo\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.497756 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.497737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-token\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.498359 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.498336 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4hgl\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-kube-api-access-q4hgl\") pod \"e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.608279 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.608186 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:43.754924 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.754895 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n"] Jul 08 22:05:43.755282 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.755248 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:43.755375 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.755325 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:43.755375 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:43.755368 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:44.069307 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:44.069268 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" event={"ID":"9e177e2c-92ce-4a28-b028-df2e06da7613","Type":"ContainerStarted","Data":"b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4"} Jul 08 22:05:44.069493 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:44.069322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" event={"ID":"9e177e2c-92ce-4a28-b028-df2e06da7613","Type":"ContainerStarted","Data":"e820172a3e991179ee699766f85bc9278e68aab43234caeb164081c5ce450bb6"} Jul 08 22:05:44.088579 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:44.088509 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" podStartSLOduration=1.088492077 podStartE2EDuration="1.088492077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:05:44.086146455 +0000 UTC m=+1961.199141178" watchObservedRunningTime="2026-07-08 22:05:44.088492077 +0000 UTC m=+1961.201486795" Jul 08 22:05:44.608778 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:44.608735 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:44.613801 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:44.613769 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:45.075165 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:45.075133 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:45.076024 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:45.076006 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:52.028616 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:52.028582 2559 patch_prober.go:28] interesting pod/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:05:52.029067 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:52.028653 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 08 22:05:52.119933 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:52.119904 2559 generic.go:356] "Generic (PLEG): container finished" podID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerID="d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7" exitCode=0 Jul 08 22:05:52.120125 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:52.119994 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" event={"ID":"1d1d7baf-c0a6-41a1-a311-fbee18c333fa","Type":"ContainerDied","Data":"d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7"} Jul 08 22:05:52.120462 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:52.120443 2559 scope.go:117] "RemoveContainer" containerID="d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7" Jul 08 22:05:52.121552 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:52.121498 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:52.121639 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:52.121577 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:52.121639 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:52.121609 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:53.126853 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:53.126822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" event={"ID":"1d1d7baf-c0a6-41a1-a311-fbee18c333fa","Type":"ContainerStarted","Data":"f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7"} Jul 08 22:05:53.952257 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:53.952216 2559 patch_prober.go:28] interesting pod/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:05:53.952452 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:53.952276 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 08 22:05:53.952575 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:53.951817 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:54.952310 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:54.952271 2559 patch_prober.go:28] interesting pod/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:05:54.952962 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:54.952922 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 08 22:05:55.698941 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:55.698905 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:05:55.952557 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:55.952442 2559 patch_prober.go:28] interesting pod/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:05:55.953123 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:55.953090 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 08 22:05:56.952437 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:56.952386 2559 patch_prober.go:28] interesting pod/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:05:56.952651 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:56.952462 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 08 22:05:57.153453 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.153419 2559 generic.go:356] "Generic (PLEG): container finished" podID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerID="b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4" exitCode=0 Jul 08 22:05:57.153822 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.153564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" event={"ID":"9e177e2c-92ce-4a28-b028-df2e06da7613","Type":"ContainerDied","Data":"b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4"} Jul 08 22:05:57.154448 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.154429 2559 scope.go:117] "RemoveContainer" containerID="b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4" Jul 08 22:05:57.156595 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.156260 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:57.156595 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.156348 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:57.156595 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.156394 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 22:05:57.961228 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.961184 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:57.964203 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.963260 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:57.967973 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:57.967951 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:05:58.173870 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:58.173832 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" event={"ID":"9e177e2c-92ce-4a28-b028-df2e06da7613","Type":"ContainerStarted","Data":"6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0"} Jul 08 22:05:58.609358 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:58.609324 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:05:58.610447 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:58.610413 2559 patch_prober.go:28] interesting pod/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 08 22:05:58.610607 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:58.610486 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 08 22:05:59.609255 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:59.609220 2559 patch_prober.go:28] interesting pod/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 08 22:05:59.609663 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:05:59.609278 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 08 22:06:00.075958 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:06:00.075917 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:06:00.609396 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:06:00.609356 2559 patch_prober.go:28] interesting pod/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 08 22:06:00.609845 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:06:00.609417 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 08 22:06:01.608645 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:06:01.608603 2559 patch_prober.go:28] interesting pod/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 08 22:06:01.608836 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:06:01.608679 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 08 22:06:02.612584 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:06:02.612554 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:06:02.613543 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:06:02.613508 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:08:03.511426 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:08:03.511397 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 22:08:03.514873 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:08:03.514846 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v76jx_26355e38-8733-43cf-a4ad-fde077a7d6ca/ovn-acl-logging/0.log" Jul 08 22:08:59.997130 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:08:59.997029 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:09:02.079931 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:02.079892 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz"] Jul 08 22:09:02.080347 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:02.080136 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" containerID="cri-o://f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7" gracePeriod=30 Jul 08 22:09:07.346602 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.346504 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:09:07.373856 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.373824 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-data\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.373856 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.373862 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-socket\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.374084 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.373895 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istiod-ca-cert\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.374084 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.373917 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-certs\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.374084 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.373939 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-envoy\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.374084 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374012 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-token\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.374084 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374038 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2zqv\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-kube-api-access-v2zqv\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.374341 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374091 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-credential-socket\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.374341 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374109 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:07.374341 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374136 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-podinfo\") pod \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\" (UID: \"1d1d7baf-c0a6-41a1-a311-fbee18c333fa\") " Jul 08 22:09:07.374341 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374265 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:07.374341 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374301 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:09:07.374711 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374428 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:07.374711 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374441 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:07.374711 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374449 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:07.374865 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374828 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:07.374865 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.374843 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:07.376745 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.376718 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:09:07.376745 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.376726 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:07.376964 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.376880 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:09:07.376964 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.376926 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-kube-api-access-v2zqv" (OuterVolumeSpecName: "kube-api-access-v2zqv") pod "1d1d7baf-c0a6-41a1-a311-fbee18c333fa" (UID: "1d1d7baf-c0a6-41a1-a311-fbee18c333fa"). InnerVolumeSpecName "kube-api-access-v2zqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:09:07.475081 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.475036 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:07.475264 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.475240 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:07.475264 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.475254 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2zqv\" (UniqueName: \"kubernetes.io/projected/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-kube-api-access-v2zqv\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:07.475342 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.475269 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:07.475342 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.475278 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:07.475342 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:07.475287 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d1d7baf-c0a6-41a1-a311-fbee18c333fa-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:08.142168 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.142132 2559 generic.go:356] "Generic (PLEG): container finished" podID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerID="f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7" exitCode=0 Jul 08 22:09:08.142360 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.142183 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" Jul 08 22:09:08.142360 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.142215 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" event={"ID":"1d1d7baf-c0a6-41a1-a311-fbee18c333fa","Type":"ContainerDied","Data":"f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7"} Jul 08 22:09:08.142360 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.142264 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz" event={"ID":"1d1d7baf-c0a6-41a1-a311-fbee18c333fa","Type":"ContainerDied","Data":"d57f2d814802d62c29cf7d8ed7f7f0beb5116df1c3d0e2b553c6724a67d9661e"} Jul 08 22:09:08.142360 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.142287 2559 scope.go:117] "RemoveContainer" containerID="f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7" Jul 08 22:09:08.152060 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.152034 2559 scope.go:117] "RemoveContainer" containerID="d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7" Jul 08 22:09:08.161639 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.161613 2559 scope.go:117] "RemoveContainer" containerID="f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7" Jul 08 22:09:08.162014 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:09:08.161989 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7\": container with ID starting with f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7 not found: ID does not exist" containerID="f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7" Jul 08 22:09:08.162109 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.162027 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7"} err="failed to get container status \"f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7\": rpc error: code = NotFound desc = could not find container \"f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7\": container with ID starting with f8ddffecee34b48d2e8871de62dc6038233c0cfb6c7c0a3a460588ef03b5eef7 not found: ID does not exist" Jul 08 22:09:08.162109 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.162050 2559 scope.go:117] "RemoveContainer" containerID="d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7" Jul 08 22:09:08.162363 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:09:08.162339 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7\": container with ID starting with d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7 not found: ID does not exist" containerID="d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7" Jul 08 22:09:08.162404 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.162374 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7"} err="failed to get container status \"d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7\": rpc error: code = NotFound desc = could not find container \"d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7\": container with ID starting with d22b98911cf9bd74d27a6930318242d0f31d2fd80b4b468ef9de8e55f61900b7 not found: ID does not exist" Jul 08 22:09:08.163454 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.163432 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz"] Jul 08 22:09:08.167864 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:08.167825 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-074c17-openshift-default-857c7c497f-x5bvz"] Jul 08 22:09:09.445135 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:09.445096 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" path="/var/lib/kubelet/pods/1d1d7baf-c0a6-41a1-a311-fbee18c333fa/volumes" Jul 08 22:09:09.498105 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:09.498067 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n"] Jul 08 22:09:09.498352 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:09.498327 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" containerID="cri-o://6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0" gracePeriod=30 Jul 08 22:09:11.694283 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:11.694247 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pc8pm"] Jul 08 22:09:14.756964 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.756929 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:09:14.828028 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.827923 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-podinfo\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.828028 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828013 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-data\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.828225 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828167 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-envoy\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.828225 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828200 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4hgl\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-kube-api-access-q4hgl\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.828314 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828227 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-token\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.828314 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828266 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e177e2c-92ce-4a28-b028-df2e06da7613-istiod-ca-cert\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.828417 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828313 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-certs\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.828478 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828458 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-credential-socket\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.828853 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828789 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:14.829010 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828893 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e177e2c-92ce-4a28-b028-df2e06da7613-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:09:14.829010 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828933 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:14.829010 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.828945 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:14.830403 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.830377 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:14.830503 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.830401 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:09:14.830711 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.830685 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-kube-api-access-q4hgl" (OuterVolumeSpecName: "kube-api-access-q4hgl") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "kube-api-access-q4hgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:09:14.830821 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.830750 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:09:14.929201 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929153 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-socket\") pod \"9e177e2c-92ce-4a28-b028-df2e06da7613\" (UID: \"9e177e2c-92ce-4a28-b028-df2e06da7613\") " Jul 08 22:09:14.929361 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929315 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-podinfo\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:14.929361 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929328 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-data\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:14.929361 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929336 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-envoy\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:14.929361 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929345 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4hgl\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-kube-api-access-q4hgl\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:14.929361 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929353 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e177e2c-92ce-4a28-b028-df2e06da7613-istio-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:14.929361 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929363 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e177e2c-92ce-4a28-b028-df2e06da7613-istiod-ca-cert\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:14.929614 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929371 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-certs\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:14.929614 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929378 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-credential-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:14.929614 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:14.929413 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e177e2c-92ce-4a28-b028-df2e06da7613" (UID: "9e177e2c-92ce-4a28-b028-df2e06da7613"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:09:15.029786 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.029740 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e177e2c-92ce-4a28-b028-df2e06da7613-workload-socket\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\"" Jul 08 22:09:15.180359 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.180269 2559 generic.go:356] "Generic (PLEG): container finished" podID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerID="6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0" exitCode=0 Jul 08 22:09:15.180359 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.180320 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" Jul 08 22:09:15.180566 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.180355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" event={"ID":"9e177e2c-92ce-4a28-b028-df2e06da7613","Type":"ContainerDied","Data":"6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0"} Jul 08 22:09:15.180566 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.180414 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n" event={"ID":"9e177e2c-92ce-4a28-b028-df2e06da7613","Type":"ContainerDied","Data":"e820172a3e991179ee699766f85bc9278e68aab43234caeb164081c5ce450bb6"} Jul 08 22:09:15.180566 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.180449 2559 scope.go:117] "RemoveContainer" containerID="6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0" Jul 08 22:09:15.190653 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.190633 2559 scope.go:117] "RemoveContainer" containerID="b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4" Jul 08 22:09:15.199685 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.199659 2559 scope.go:117] "RemoveContainer" containerID="6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0" Jul 08 22:09:15.200037 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:09:15.200014 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0\": container with ID starting with 6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0 not found: ID does not exist" containerID="6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0" Jul 08 22:09:15.200084 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.200047 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0"} err="failed to get container status \"6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0\": rpc error: code = NotFound desc = could not find container \"6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0\": container with ID starting with 6c344985116118637e15f10c31e1eb1686bc0d3c7031758f286619891f999aa0 not found: ID does not exist" Jul 08 22:09:15.200084 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.200068 2559 scope.go:117] "RemoveContainer" containerID="b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4" Jul 08 22:09:15.200332 ip-10-0-143-77 kubenswrapper[2559]: E0708 22:09:15.200317 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4\": container with ID starting with b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4 not found: ID does not exist" containerID="b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4" Jul 08 22:09:15.200378 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.200337 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4"} err="failed to get container status \"b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4\": rpc error: code = NotFound desc = could not find container \"b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4\": container with ID starting with b4ad1d56177ba53dd0b2c33d81a0057c74f44c21604d0af2f8b0de29e64c8bc4 not found: ID does not exist" Jul 08 22:09:15.207784 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.207750 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n"] Jul 08 22:09:15.212154 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.212121 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-4df112-openshift-default-7d55c866f9-88f4n"] Jul 08 22:09:15.445092 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:15.445047 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" path="/var/lib/kubelet/pods/9e177e2c-92ce-4a28-b028-df2e06da7613/volumes" Jul 08 22:09:16.005969 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:16.005942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c97f5c75f-w5z9g_31ff14dd-e71e-4ca6-8221-f79175d1a23a/copy-manifests/0.log" Jul 08 22:09:16.026445 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:16.026413 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c97f5c75f-w5z9g_31ff14dd-e71e-4ca6-8221-f79175d1a23a/manager/0.log" Jul 08 22:09:16.854278 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:16.854239 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876_06174813-b248-48fd-a609-277e6d639b65/extract/0.log" Jul 08 22:09:16.860603 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:16.860579 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876_06174813-b248-48fd-a609-277e6d639b65/util/0.log" Jul 08 22:09:16.867405 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:16.867370 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876_06174813-b248-48fd-a609-277e6d639b65/pull/0.log" Jul 08 22:09:16.983261 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:16.983229 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57_eaab09ac-52cf-463d-9260-a477762db7f8/util/0.log" Jul 08 22:09:16.989357 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:16.989327 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57_eaab09ac-52cf-463d-9260-a477762db7f8/pull/0.log" Jul 08 22:09:16.995537 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:16.995480 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57_eaab09ac-52cf-463d-9260-a477762db7f8/extract/0.log" Jul 08 22:09:17.117305 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:17.117221 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242_cb232953-43ca-4c92-819d-c7ac50ccdb13/util/0.log" Jul 08 22:09:17.127559 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:17.127512 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242_cb232953-43ca-4c92-819d-c7ac50ccdb13/pull/0.log" Jul 08 22:09:17.135132 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:17.135103 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242_cb232953-43ca-4c92-819d-c7ac50ccdb13/extract/0.log" Jul 08 22:09:17.251965 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:17.251936 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl_6f94466d-f09b-481c-be9e-43fa44bc66f9/util/0.log" Jul 08 22:09:17.258932 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:17.258907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl_6f94466d-f09b-481c-be9e-43fa44bc66f9/pull/0.log" Jul 08 22:09:17.266152 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:17.266128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl_6f94466d-f09b-481c-be9e-43fa44bc66f9/extract/0.log" Jul 08 22:09:18.149146 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:18.149114 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pc8pm_1d208004-2d58-4663-9709-0b7e08487d79/limitador/0.log" Jul 08 22:09:18.629191 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:18.629157 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47xmsn_5f320823-f669-42e7-a343-d842c26f069f/istio-proxy/0.log" Jul 08 22:09:18.756528 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:18.756480 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c7pwd_7d391ce9-4f16-4123-b697-b3e3b97933a9/discovery/0.log" Jul 08 22:09:20.180401 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:20.180364 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2dgp4_999e4365-a5a3-4a6a-ae08-c1dea32150d8/main/0.log" Jul 08 22:09:25.165953 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.165914 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pfvkg/must-gather-g8htx"] Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166231 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166242 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166254 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166259 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166272 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166278 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166290 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166295 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7001ea-00f4-4a47-8c24-222e3632a0d4" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166302 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" Jul 08 22:09:25.166350 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166307 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" Jul 08 22:09:25.166809 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166708 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" Jul 08 22:09:25.166809 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166730 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d1d7baf-c0a6-41a1-a311-fbee18c333fa" containerName="istio-proxy" Jul 08 22:09:25.166809 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166755 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" Jul 08 22:09:25.166809 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.166764 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e177e2c-92ce-4a28-b028-df2e06da7613" containerName="istio-proxy" Jul 08 22:09:25.175725 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.175685 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfvkg/must-gather-g8htx" Jul 08 22:09:25.178352 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.178322 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfvkg\"/\"openshift-service-ca.crt\"" Jul 08 22:09:25.178506 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.178411 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pfvkg\"/\"default-dockercfg-qjbz2\"" Jul 08 22:09:25.178506 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.178472 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pfvkg\"/\"kube-root-ca.crt\"" Jul 08 22:09:25.182580 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.182552 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfvkg/must-gather-g8htx"] Jul 08 22:09:25.223331 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.223294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72q2d\" (UniqueName: \"kubernetes.io/projected/02dbfe7a-17fb-4a83-ac04-c14c11482391-kube-api-access-72q2d\") pod \"must-gather-g8htx\" (UID: \"02dbfe7a-17fb-4a83-ac04-c14c11482391\") " pod="openshift-must-gather-pfvkg/must-gather-g8htx" Jul 08 22:09:25.223492 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.223341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02dbfe7a-17fb-4a83-ac04-c14c11482391-must-gather-output\") pod \"must-gather-g8htx\" (UID: \"02dbfe7a-17fb-4a83-ac04-c14c11482391\") " pod="openshift-must-gather-pfvkg/must-gather-g8htx" Jul 08 22:09:25.324087 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.324042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02dbfe7a-17fb-4a83-ac04-c14c11482391-must-gather-output\") pod \"must-gather-g8htx\" (UID: \"02dbfe7a-17fb-4a83-ac04-c14c11482391\") " pod="openshift-must-gather-pfvkg/must-gather-g8htx" Jul 08 22:09:25.324275 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.324142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72q2d\" (UniqueName: \"kubernetes.io/projected/02dbfe7a-17fb-4a83-ac04-c14c11482391-kube-api-access-72q2d\") pod \"must-gather-g8htx\" (UID: \"02dbfe7a-17fb-4a83-ac04-c14c11482391\") " pod="openshift-must-gather-pfvkg/must-gather-g8htx" Jul 08 22:09:25.324401 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.324380 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02dbfe7a-17fb-4a83-ac04-c14c11482391-must-gather-output\") pod \"must-gather-g8htx\" (UID: \"02dbfe7a-17fb-4a83-ac04-c14c11482391\") " pod="openshift-must-gather-pfvkg/must-gather-g8htx" Jul 08 22:09:25.332240 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.332206 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72q2d\" (UniqueName: \"kubernetes.io/projected/02dbfe7a-17fb-4a83-ac04-c14c11482391-kube-api-access-72q2d\") pod \"must-gather-g8htx\" (UID: \"02dbfe7a-17fb-4a83-ac04-c14c11482391\") " pod="openshift-must-gather-pfvkg/must-gather-g8htx" Jul 08 22:09:25.487668 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.487631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfvkg/must-gather-g8htx" Jul 08 22:09:25.633250 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.633218 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfvkg/must-gather-g8htx"] Jul 08 22:09:25.634925 ip-10-0-143-77 kubenswrapper[2559]: W0708 22:09:25.634896 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02dbfe7a_17fb_4a83_ac04_c14c11482391.slice/crio-37a6d75748b2df75f39653e3ae8f593caa5575f39847f521176bf7860a2749b9 WatchSource:0}: Error finding container 37a6d75748b2df75f39653e3ae8f593caa5575f39847f521176bf7860a2749b9: Status 404 returned error can't find the container with id 37a6d75748b2df75f39653e3ae8f593caa5575f39847f521176bf7860a2749b9 Jul 08 22:09:25.637332 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:25.637313 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 22:09:26.242613 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:26.242572 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfvkg/must-gather-g8htx" event={"ID":"02dbfe7a-17fb-4a83-ac04-c14c11482391","Type":"ContainerStarted","Data":"37a6d75748b2df75f39653e3ae8f593caa5575f39847f521176bf7860a2749b9"} Jul 08 22:09:27.251396 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:27.251353 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfvkg/must-gather-g8htx" event={"ID":"02dbfe7a-17fb-4a83-ac04-c14c11482391","Type":"ContainerStarted","Data":"0d55e68f131251d105104e72244f8d4baaf14af7b3c63b02fab9f02ed90e1c37"} Jul 08 22:09:27.251396 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:27.251405 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfvkg/must-gather-g8htx" event={"ID":"02dbfe7a-17fb-4a83-ac04-c14c11482391","Type":"ContainerStarted","Data":"d80a81a7922910718cd56708c235c59fac77ad57d5e8a0e91da3bc85a89dd615"} Jul 08 22:09:27.273629 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:27.273574 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pfvkg/must-gather-g8htx" podStartSLOduration=1.533487268 podStartE2EDuration="2.273555171s" totalImagesPullingTime="740.067903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:09:27.272451318 +0000 UTC m=+2184.385446036" watchObservedRunningTime="2026-07-08 22:09:27.273555171 +0000 UTC m=+2184.386549867" Jul 08 22:09:28.322551 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:28.319589 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wffhf_58e2dcf6-3fd0-48a4-b8de-38f0781c9f8d/global-pull-secret-syncer/0.log" Jul 08 22:09:28.462003 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:28.461947 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vx886_87e5bf7a-f29e-48f2-98c4-7554baa9c483/konnectivity-agent/0.log" Jul 08 22:09:28.540923 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:28.540880 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-77.ec2.internal_bbda490fa50675fa459f3fc992f874a7/haproxy/0.log" Jul 08 22:09:32.689645 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:32.689594 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876_06174813-b248-48fd-a609-277e6d639b65/extract/0.log" Jul 08 22:09:32.756316 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:32.756281 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876_06174813-b248-48fd-a609-277e6d639b65/util/0.log" Jul 08 22:09:32.814200 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:32.814161 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x876_06174813-b248-48fd-a609-277e6d639b65/pull/0.log" Jul 08 22:09:32.874072 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:32.874029 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57_eaab09ac-52cf-463d-9260-a477762db7f8/extract/0.log" Jul 08 22:09:32.900228 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:32.900195 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57_eaab09ac-52cf-463d-9260-a477762db7f8/util/0.log" Jul 08 22:09:32.944863 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:32.944758 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hfc57_eaab09ac-52cf-463d-9260-a477762db7f8/pull/0.log" Jul 08 22:09:32.973130 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:32.973094 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242_cb232953-43ca-4c92-819d-c7ac50ccdb13/extract/0.log" Jul 08 22:09:32.994226 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:32.994191 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242_cb232953-43ca-4c92-819d-c7ac50ccdb13/util/0.log" Jul 08 22:09:33.025872 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:33.025815 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rv242_cb232953-43ca-4c92-819d-c7ac50ccdb13/pull/0.log" Jul 08 22:09:33.060157 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:33.060122 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl_6f94466d-f09b-481c-be9e-43fa44bc66f9/extract/0.log" Jul 08 22:09:33.088584 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:33.088550 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl_6f94466d-f09b-481c-be9e-43fa44bc66f9/util/0.log" Jul 08 22:09:33.129139 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:33.129105 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18mwfl_6f94466d-f09b-481c-be9e-43fa44bc66f9/pull/0.log" Jul 08 22:09:33.880888 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:33.880855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pc8pm_1d208004-2d58-4663-9709-0b7e08487d79/limitador/0.log" Jul 08 22:09:35.733299 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:35.733251 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jlv9n_05f7fe17-7a6f-433f-be87-121eaa21fe06/kube-state-metrics/0.log" Jul 08 22:09:35.760348 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:35.760316 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jlv9n_05f7fe17-7a6f-433f-be87-121eaa21fe06/kube-rbac-proxy-main/0.log" Jul 08 22:09:35.794541 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:35.794499 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jlv9n_05f7fe17-7a6f-433f-be87-121eaa21fe06/kube-rbac-proxy-self/0.log" Jul 08 22:09:35.903420 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:35.903385 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-749x4_4e533842-22eb-41c2-85b2-0e87649c2f69/node-exporter/0.log" Jul 08 22:09:35.926883 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:35.926856 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-749x4_4e533842-22eb-41c2-85b2-0e87649c2f69/kube-rbac-proxy/0.log" Jul 08 22:09:35.950713 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:35.950679 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-749x4_4e533842-22eb-41c2-85b2-0e87649c2f69/init-textfile/0.log" Jul 08 22:09:36.492208 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.492180 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-797b4545c6-h4wlc_ed81dc10-a835-4632-8c31-8fbeee61151f/telemeter-client/0.log" Jul 08 22:09:36.518575 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.518547 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-797b4545c6-h4wlc_ed81dc10-a835-4632-8c31-8fbeee61151f/reload/0.log" Jul 08 22:09:36.540310 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.540272 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-797b4545c6-h4wlc_ed81dc10-a835-4632-8c31-8fbeee61151f/kube-rbac-proxy/0.log" Jul 08 22:09:36.577641 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.577605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c9b649967-9tnhd_0bb8699e-8209-4c49-9529-c3b3e69453de/thanos-query/0.log" Jul 08 22:09:36.600136 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.600104 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c9b649967-9tnhd_0bb8699e-8209-4c49-9529-c3b3e69453de/kube-rbac-proxy-web/0.log" Jul 08 22:09:36.622582 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.622547 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c9b649967-9tnhd_0bb8699e-8209-4c49-9529-c3b3e69453de/kube-rbac-proxy/0.log" Jul 08 22:09:36.644674 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.644646 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c9b649967-9tnhd_0bb8699e-8209-4c49-9529-c3b3e69453de/prom-label-proxy/0.log" Jul 08 22:09:36.665221 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.665190 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c9b649967-9tnhd_0bb8699e-8209-4c49-9529-c3b3e69453de/kube-rbac-proxy-rules/0.log" Jul 08 22:09:36.688215 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:36.688173 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c9b649967-9tnhd_0bb8699e-8209-4c49-9529-c3b3e69453de/kube-rbac-proxy-metrics/0.log" Jul 08 22:09:38.657173 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.657139 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb"] Jul 08 22:09:38.663096 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.663064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.668054 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.668014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb"] Jul 08 22:09:38.764634 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.764599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-lib-modules\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.764995 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.764977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-sys\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.765151 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.765139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-proc\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.765349 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.765335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gf8w\" (UniqueName: \"kubernetes.io/projected/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-kube-api-access-9gf8w\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.765490 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.765478 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-podres\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866662 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-lib-modules\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866838 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-sys\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866838 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-proc\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866838 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gf8w\" (UniqueName: \"kubernetes.io/projected/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-kube-api-access-9gf8w\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866838 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866790 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-podres\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866975 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866839 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-proc\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866975 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-lib-modules\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866975 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866920 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-podres\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.866975 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.866939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-sys\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.875362 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.875317 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gf8w\" (UniqueName: \"kubernetes.io/projected/a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c-kube-api-access-9gf8w\") pod \"perf-node-gather-daemonset-786sb\" (UID: \"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c\") " pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:38.981829 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:38.981787 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:39.023078 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:39.023040 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f674f7df9-6tws6_6cb7bbec-2a1c-44ee-85b5-aa72fff159a2/console/0.log" Jul 08 22:09:39.211153 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:39.205205 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb"] Jul 08 22:09:39.345661 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:39.345620 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" event={"ID":"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c","Type":"ContainerStarted","Data":"f7ab69bfa9d316c5cf6e12086b4e90ad391cdc00874495f416222764cc8d6e3f"} Jul 08 22:09:40.356822 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:40.356759 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" event={"ID":"a2ca3cd1-8c9e-406b-8cd3-9e524b08c59c","Type":"ContainerStarted","Data":"912d81538ae65b9b414b95687e11275d143d77e0d82cf82199485e7f80b2fe9a"} Jul 08 22:09:40.357271 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:40.356997 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:40.377212 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:40.377142 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" podStartSLOduration=2.377120179 podStartE2EDuration="2.377120179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:09:40.374553729 +0000 UTC m=+2197.487548447" watchObservedRunningTime="2026-07-08 22:09:40.377120179 +0000 UTC m=+2197.490114897" Jul 08 22:09:40.899339 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:40.899302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gtbqt_8d464437-f8bc-4a0e-aaf0-4cacfc0033d5/dns/0.log" Jul 08 22:09:40.920491 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:40.920457 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gtbqt_8d464437-f8bc-4a0e-aaf0-4cacfc0033d5/kube-rbac-proxy/0.log" Jul 08 22:09:40.942964 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:40.942936 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-792s4_ea5c4287-d7ea-4953-8883-a7d627071421/dns-node-resolver/0.log" Jul 08 22:09:41.542265 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:41.542224 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75d8f6dd6c-4rlj2_a0484dff-4386-4817-9f95-8b85b78a3002/registry/0.log" Jul 08 22:09:41.567371 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:41.567329 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44cx7_dd6a682f-5056-4a76-bb8e-9cd16d4ff7c6/node-ca/0.log" Jul 08 22:09:42.553535 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:42.553490 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47xmsn_5f320823-f669-42e7-a343-d842c26f069f/istio-proxy/0.log" Jul 08 22:09:42.741176 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:42.741139 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c7pwd_7d391ce9-4f16-4123-b697-b3e3b97933a9/discovery/0.log" Jul 08 22:09:43.806153 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:43.806117 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fml67_f449634b-9f5a-42c0-9db6-9ac933d753ae/serve-healthcheck-canary/0.log" Jul 08 22:09:44.431331 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:44.431295 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrrlw_5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72/kube-rbac-proxy/0.log" Jul 08 22:09:44.453021 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:44.452984 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrrlw_5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72/exporter/0.log" Jul 08 22:09:44.475315 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:44.475278 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrrlw_5cbeb8e4-fe15-4baa-b0b5-397c3b91bc72/extractor/0.log" Jul 08 22:09:46.377251 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:46.377221 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pfvkg/perf-node-gather-daemonset-786sb" Jul 08 22:09:47.397934 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:47.397604 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c97f5c75f-w5z9g_31ff14dd-e71e-4ca6-8221-f79175d1a23a/manager/0.log" Jul 08 22:09:47.415653 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:47.415618 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c97f5c75f-w5z9g_31ff14dd-e71e-4ca6-8221-f79175d1a23a/copy-manifests/0.log" Jul 08 22:09:48.853611 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:48.853572 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-857546b9c4-5s2b4_758bbdf6-6ec5-4b67-b3ec-4c6061416aec/manager/0.log" Jul 08 22:09:48.904315 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:48.904264 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2s4nm_ccbb44d2-5837-4b46-9c1c-86eb556a920b/openshift-lws-operator/0.log" Jul 08 22:09:49.371331 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:49.371301 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47xmsn_5f320823-f669-42e7-a343-d842c26f069f/istio-proxy/0.log" Jul 08 22:09:49.538210 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:49.538174 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c7pwd_7d391ce9-4f16-4123-b697-b3e3b97933a9/discovery/0.log" Jul 08 22:09:51.014419 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:51.014373 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47xmsn_5f320823-f669-42e7-a343-d842c26f069f/istio-proxy/0.log" Jul 08 22:09:51.190137 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:51.190091 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c7pwd_7d391ce9-4f16-4123-b697-b3e3b97933a9/discovery/0.log" Jul 08 22:09:55.504881 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.504852 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9fng_d9cd29c1-4f21-4d00-b8f8-9ad130e0979f/kube-multus-additional-cni-plugins/0.log" Jul 08 22:09:55.525208 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.525178 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9fng_d9cd29c1-4f21-4d00-b8f8-9ad130e0979f/egress-router-binary-copy/0.log" Jul 08 22:09:55.545512 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.545481 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9fng_d9cd29c1-4f21-4d00-b8f8-9ad130e0979f/cni-plugins/0.log" Jul 08 22:09:55.574402 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.574367 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9fng_d9cd29c1-4f21-4d00-b8f8-9ad130e0979f/bond-cni-plugin/0.log" Jul 08 22:09:55.596192 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.596161 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9fng_d9cd29c1-4f21-4d00-b8f8-9ad130e0979f/routeoverride-cni/0.log" Jul 08 22:09:55.619188 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.619153 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9fng_d9cd29c1-4f21-4d00-b8f8-9ad130e0979f/whereabouts-cni-bincopy/0.log" Jul 08 22:09:55.639276 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.639243 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9fng_d9cd29c1-4f21-4d00-b8f8-9ad130e0979f/whereabouts-cni/0.log" Jul 08 22:09:55.824436 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.824341 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pbcmq_031fa896-6c07-4e1c-9044-7ee0a6951a3c/kube-multus/0.log" Jul 08 22:09:55.958987 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.958956 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rszm5_c83c1b24-4d75-435c-8806-d2e2e1ac0e6d/network-metrics-daemon/0.log" Jul 08 22:09:55.980703 ip-10-0-143-77 kubenswrapper[2559]: I0708 22:09:55.980666 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rszm5_c83c1b24-4d75-435c-8806-d2e2e1ac0e6d/kube-rbac-proxy/0.log"