Jul 08 17:17:21.597059 ip-10-0-131-141 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 17:17:21.597075 ip-10-0-131-141 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 17:17:21.597085 ip-10-0-131-141 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 17:17:21.597429 ip-10-0-131-141 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 17:17:31.641525 ip-10-0-131-141 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 17:17:31.641543 ip-10-0-131-141 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ff02b5dbfd1d4052bdf757a2ebfe00d5 -- Jul 08 17:19:09.424159 ip-10-0-131-141 systemd[1]: Starting Kubernetes Kubelet... Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.817517 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.822984 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.822997 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823001 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823004 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823007 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823010 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823013 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:09.835243 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823015 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823018 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823024 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823028 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823031 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823035 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823037 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823040 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823043 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823045 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823048 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823051 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823054 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823056 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823058 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823061 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823064 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823067 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823069 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823072 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:09.850467 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823075 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823078 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823081 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823084 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823087 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823090 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823093 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823095 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823098 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823101 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823103 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823106 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823108 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823111 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823115 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823117 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823120 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823122 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823131 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823134 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:09.962363 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823137 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:09.889711 ip-10-0-131-141 systemd[1]: Started Kubernetes Kubelet. Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823139 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823142 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823144 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823147 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823149 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823152 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823154 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823157 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823162 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823165 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823169 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823172 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823176 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823179 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823183 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823186 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823189 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823191 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:10.108051 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823194 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823196 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823199 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823202 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823204 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823207 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823210 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823212 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823215 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823217 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823220 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823222 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823231 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823234 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823236 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823239 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823241 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823244 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823246 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:10.114827 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823249 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823251 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823254 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823257 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823259 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823262 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823264 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823267 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823269 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823272 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823274 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823277 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823279 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.823282 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826024 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826164 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826168 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826172 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826174 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826178 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:10.115520 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826181 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826185 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826188 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826193 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826198 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826200 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826203 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826206 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826209 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826212 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826215 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826218 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826220 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826223 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826225 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826229 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826232 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826234 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826237 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:10.116176 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826239 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826242 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826245 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826247 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826250 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826253 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826256 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826258 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826266 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826269 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826271 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826274 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826277 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826279 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826282 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826284 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826287 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826293 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826297 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826300 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:10.116789 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826303 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826306 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826309 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826312 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826314 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826317 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826321 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826325 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826329 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826331 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826334 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826338 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826341 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826343 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826346 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826349 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826351 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826354 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826357 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:10.117410 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826359 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826363 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826366 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826368 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826371 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826374 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826377 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826380 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826383 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826386 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826388 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826391 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826394 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826396 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826399 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826402 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826406 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826409 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826411 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826415 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:10.118016 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826417 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826420 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826427 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826429 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826432 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826435 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826437 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826440 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826443 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826446 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826450 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826453 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826455 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826458 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826461 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826875 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826881 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826884 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826887 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826889 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:10.118587 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826892 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826895 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826898 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826900 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826903 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826905 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826908 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826910 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826913 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826917 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826921 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826924 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826927 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826930 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826934 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826937 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826939 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826942 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826945 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:10.119227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826947 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826950 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826952 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826956 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826959 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826961 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826964 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826966 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826969 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826972 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826974 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826977 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826979 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826983 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826985 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826988 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826990 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826993 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826996 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.826998 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:10.119778 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827001 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827003 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827006 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827008 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827011 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827014 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827017 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827021 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827023 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827026 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827028 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827031 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827034 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827036 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827039 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827043 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827046 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827048 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827051 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827053 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:10.120468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827056 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827058 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827061 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827064 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827066 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827069 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827071 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827074 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827076 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827079 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827081 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827083 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827087 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827089 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827094 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827097 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827100 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827102 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827106 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827110 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:10.121477 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827112 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827115 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827119 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827122 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827125 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827128 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827131 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827134 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827137 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827140 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827142 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827145 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827148 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827150 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827153 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827228 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827235 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827242 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827246 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827251 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827254 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 17:19:10.122516 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827258 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827263 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827266 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827268 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827272 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827275 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827278 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827281 2578 flags.go:64] FLAG: --cgroup-root="" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827284 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827287 2578 flags.go:64] FLAG: --client-ca-file="" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827292 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827294 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827299 2578 flags.go:64] FLAG: --cluster-domain="" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827301 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827304 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827307 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827311 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827314 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827319 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827322 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827325 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827328 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827331 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827334 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 17:19:10.123294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827337 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827340 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827344 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827347 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827350 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827353 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827356 2578 flags.go:64] FLAG: --enable-server="true" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827359 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827364 2578 flags.go:64] FLAG: --event-burst="100" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827367 2578 flags.go:64] FLAG: --event-qps="50" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827370 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827373 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827375 2578 flags.go:64] FLAG: --eviction-hard="" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827379 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827382 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827385 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827388 2578 flags.go:64] FLAG: --eviction-soft="" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827390 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827394 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827398 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827401 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827404 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827406 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827409 2578 flags.go:64] FLAG: --feature-gates="" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827413 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 17:19:10.124102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827416 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827420 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827423 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827427 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827429 2578 flags.go:64] FLAG: --help="false" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827432 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827435 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827438 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827441 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827444 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827448 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827451 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827454 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827456 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827459 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827462 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827465 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827468 2578 flags.go:64] FLAG: --kube-reserved="" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827471 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827474 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827477 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827480 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827482 2578 flags.go:64] FLAG: --lock-file="" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827485 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 17:19:10.125119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827488 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827493 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827498 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827501 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827504 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827507 2578 flags.go:64] FLAG: --logging-format="text" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827510 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827513 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827515 2578 flags.go:64] FLAG: --manifest-url="" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827519 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827524 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827527 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827531 2578 flags.go:64] FLAG: --max-pods="110" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827534 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827537 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827540 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827543 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827546 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827549 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827552 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827559 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827562 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827565 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 17:19:10.125777 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827568 2578 flags.go:64] FLAG: --pod-cidr="" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827571 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827576 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827579 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827582 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827585 2578 flags.go:64] FLAG: --port="10250" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827588 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827591 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09828d115061c4781" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827594 2578 flags.go:64] FLAG: --qos-reserved="" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827597 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827600 2578 flags.go:64] FLAG: --register-node="true" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827604 2578 flags.go:64] FLAG: --register-with-taints="" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827608 2578 flags.go:64] FLAG: --registry-burst="10" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827612 2578 flags.go:64] FLAG: --registry-qps="5" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827614 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827617 2578 flags.go:64] FLAG: --reserved-memory="" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827621 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827624 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827628 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827631 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827634 2578 flags.go:64] FLAG: --runonce="false" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827636 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827639 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827642 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827645 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 17:19:10.126431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827648 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827650 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827653 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827656 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827659 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827661 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827664 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827667 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827670 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827673 2578 flags.go:64] FLAG: --system-cgroups="" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827676 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827681 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827683 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827686 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827690 2578 flags.go:64] FLAG: --tls-min-version="" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827693 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827695 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827698 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827703 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827706 2578 flags.go:64] FLAG: --v="2" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827709 2578 flags.go:64] FLAG: --version="false" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827714 2578 flags.go:64] FLAG: --vmodule="" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827718 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.827721 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 17:19:10.127153 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827846 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827867 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827871 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827874 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827877 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827879 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827882 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827884 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827888 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827890 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827893 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827895 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827898 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827901 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827903 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827906 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827909 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827911 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827914 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827916 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:10.127890 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827919 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827922 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827925 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827927 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827930 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827932 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827936 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827939 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827941 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827944 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827947 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827949 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827952 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827956 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827961 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827964 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827967 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827970 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827973 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827976 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:10.128498 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827979 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827982 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827985 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827987 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827990 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827992 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827995 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.827997 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828000 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828002 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828005 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828007 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828010 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828012 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828015 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828018 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828022 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828024 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828030 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:10.264544 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828033 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828036 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828039 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828042 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828045 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828048 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828052 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828055 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828058 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828061 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828063 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828066 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828068 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828071 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828073 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828076 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828079 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828081 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828083 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828086 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:10.265229 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828089 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828091 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828094 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828096 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828099 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828101 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828104 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828106 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828109 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828111 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828113 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828117 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828120 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828122 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828125 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828127 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828130 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828155 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828159 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:10.266550 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.828162 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.828768 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.835233 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.835255 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.835277 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.835283 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835339 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835344 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835347 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835351 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835353 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835357 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835360 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835364 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835366 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:10.267200 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835369 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835372 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835375 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835377 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835380 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835384 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835389 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835392 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835395 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835397 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835400 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835403 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835406 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835409 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835413 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835415 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835418 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835422 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835426 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:10.447341 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835430 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835434 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835437 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835440 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835443 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835446 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835449 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835452 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835454 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835457 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835460 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835463 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835465 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835468 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835470 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835473 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835475 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835478 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835481 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835483 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835486 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:10.448057 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835489 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835491 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835494 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835496 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835499 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835502 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835505 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835508 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835510 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835513 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835515 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835518 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835520 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835524 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835527 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835529 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835532 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835534 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835537 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835540 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:10.448664 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835542 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835545 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835547 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835549 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835552 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835554 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835557 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835559 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835562 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835567 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835569 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835574 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835576 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835579 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835582 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835586 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835589 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835592 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835595 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:10.449248 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835598 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835600 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835603 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835605 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835608 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835610 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835613 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835619 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835621 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835624 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835627 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.835632 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835741 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835747 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:19:10.449755 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835750 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835753 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835756 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835759 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835762 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835764 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835767 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835769 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835772 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835775 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835781 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835784 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835787 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835790 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835794 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835796 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835799 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835802 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835805 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:19:10.450185 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835807 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835810 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835813 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835815 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835818 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835820 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835823 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835826 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835828 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835831 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835833 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835836 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835838 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835841 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835843 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835846 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835867 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835871 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835873 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835876 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:19:10.450691 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835878 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835881 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835885 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835891 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835894 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835897 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835900 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835902 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835905 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835907 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835910 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835913 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835915 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835918 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835920 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835923 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835926 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835928 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835931 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:19:10.451256 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835933 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835937 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835939 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835942 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835944 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835947 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835950 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835952 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835955 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835957 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835959 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835962 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835965 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835967 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835970 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835974 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835978 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835980 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835983 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835985 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:19:10.451752 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835988 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835990 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835993 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835995 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.835998 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836001 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836003 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836006 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836008 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836011 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836013 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836016 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836018 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836021 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836024 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836026 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836029 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836032 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:19:10.452321 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:09.836034 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.836039 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.836146 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.838074 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.840126 2578 server.go:1019] "Starting client certificate rotation" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.840220 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.840257 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.842656 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.843862 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.860913 2578 log.go:25] "Validated CRI v1 runtime API" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.862889 2578 log.go:25] "Validated CRI v1 image API" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.863636 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 17:19:10.452810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.865918 2578 fs.go:135] Filesystem UUIDs: map[202cf811-1751-4a00-89d8-024f35b2d188:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d50c51e6-4d80-4785-88c8-f5a7154624b5:/dev/nvme0n1p4] Jul 08 17:19:10.453205 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.865934 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 17:19:10.453205 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.871612 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.871581 2578 manager.go:216] Machine: {Timestamp:2026-07-08 17:19:09.869941138 +0000 UTC m=+0.329153662 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101205 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b88fa7144ed567892a81ea3bf1bde SystemUUID:ec2b88fa-7144-ed56-7892-a81ea3bf1bde BootID:ff02b5db-fd1d-4052-bdf7-57a2ebfe00d5 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:49:17:41:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:49:17:41:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:af:af:3e:ce:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.871723 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.871805 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.873594 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.873618 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-141.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.874767 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.874776 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.874785 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.875305 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.876497 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.879553 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.879663 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.879689 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.879699 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.879709 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.879717 2578 kubelet.go:398] "Adding apiserver pod source" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.879728 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 17:19:10.453375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.880097 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.880127 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.882184 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.884006 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.884033 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.884994 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885007 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885013 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885020 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885027 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885033 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885040 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885045 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885052 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885057 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885066 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885071 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885720 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.885726 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.888812 2578 server.go:1268] "Started kubelet" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.888921 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.888945 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.888978 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.890460 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.894875 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.894875 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.895176 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.895187 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-141.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.896326 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.897125 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-141.ec2.internal.18c060219af710cf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-141.ec2.internal,UID:ip-10-0-131-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-141.ec2.internal,},FirstTimestamp:2026-07-08 17:19:09.888786639 +0000 UTC m=+0.347999161,LastTimestamp:2026-07-08 17:19:09.888786639 +0000 UTC m=+0.347999161,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-141.ec2.internal,}" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.899479 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.899487 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.899572 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900124 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900169 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900253 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900367 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900375 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900690 2578 factory.go:153] Registering CRI-O factory Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900712 2578 factory.go:223] Registration of the crio container factory successfully Jul 08 17:19:10.453895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900758 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900764 2578 factory.go:55] Registering systemd factory Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900769 2578 factory.go:223] Registration of the systemd container factory successfully Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900845 2578 factory.go:103] Registering Raw factory Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.900877 2578 manager.go:1196] Started watching for new ooms in manager Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.901330 2578 manager.go:349] Starting recovery of all containers Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.906625 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-141.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.906791 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.912983 2578 manager.go:354] Recovery completed Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.917091 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.918876 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.918903 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.918913 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.919421 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.919430 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.919443 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.919474 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.920141 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.920183 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.920199 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.920567 2578 policy_none.go:49] "None policy: Start" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.920578 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.920588 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.921505 2578 policy_none.go:47] "Start" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.921938 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-141.ec2.internal.18c060219cc265e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-141.ec2.internal,UID:ip-10-0-131-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-141.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-141.ec2.internal,},FirstTimestamp:2026-07-08 17:19:09.918889449 +0000 UTC m=+0.378101974,LastTimestamp:2026-07-08 17:19:09.918889449 +0000 UTC m=+0.378101974,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-141.ec2.internal,}" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.922941 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zck5" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.930649 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zck5" Jul 08 17:19:10.454974 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.931299 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-141.ec2.internal.18c060219cc2ae7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-141.ec2.internal,UID:ip-10-0-131-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-141.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-141.ec2.internal,},FirstTimestamp:2026-07-08 17:19:09.918908031 +0000 UTC m=+0.378120554,LastTimestamp:2026-07-08 17:19:09.918908031 +0000 UTC m=+0.378120554,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-141.ec2.internal,}" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.933038 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-141.ec2.internal.18c060219cc2d267 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-141.ec2.internal,UID:ip-10-0-131-141.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-141.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-141.ec2.internal,},FirstTimestamp:2026-07-08 17:19:09.918917223 +0000 UTC m=+0.378129746,LastTimestamp:2026-07-08 17:19:09.918917223 +0000 UTC m=+0.378129746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-141.ec2.internal,}" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.981428 2578 manager.go:337] "Starting Device Plugin manager" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.981469 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.981482 2578 server.go:87] "Starting device plugin registration server" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.981766 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.981778 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.981978 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.982049 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:09.982060 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.982509 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:09.982564 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.003898 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.005196 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.005227 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.005248 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.005284 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.007692 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.082222 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.083424 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.083466 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.083479 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.083504 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.093145 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.093171 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-141.ec2.internal\": node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.106139 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal"] Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.106193 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.108091 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.108115 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.108130 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.109460 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.109634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.109663 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.110404 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.110425 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.110436 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.110784 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:10.455670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.110804 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.110818 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.111698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.111722 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.112374 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.112394 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.112406 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.120524 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.174582 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-141.ec2.internal\" not found" node="ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.178985 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-141.ec2.internal\" not found" node="ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.200655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d71eb1a28a9e5c1e4bb6ce183a331460-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal\" (UID: \"d71eb1a28a9e5c1e4bb6ce183a331460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.200677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d71eb1a28a9e5c1e4bb6ce183a331460-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal\" (UID: \"d71eb1a28a9e5c1e4bb6ce183a331460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.200710 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b21606e895bcddad53722ead70cb377-config\") pod \"kube-apiserver-proxy-ip-10-0-131-141.ec2.internal\" (UID: \"1b21606e895bcddad53722ead70cb377\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.221563 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.301551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b21606e895bcddad53722ead70cb377-config\") pod \"kube-apiserver-proxy-ip-10-0-131-141.ec2.internal\" (UID: \"1b21606e895bcddad53722ead70cb377\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.301581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d71eb1a28a9e5c1e4bb6ce183a331460-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal\" (UID: \"d71eb1a28a9e5c1e4bb6ce183a331460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.301597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d71eb1a28a9e5c1e4bb6ce183a331460-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal\" (UID: \"d71eb1a28a9e5c1e4bb6ce183a331460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.301647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d71eb1a28a9e5c1e4bb6ce183a331460-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal\" (UID: \"d71eb1a28a9e5c1e4bb6ce183a331460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.301652 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b21606e895bcddad53722ead70cb377-config\") pod \"kube-apiserver-proxy-ip-10-0-131-141.ec2.internal\" (UID: \"1b21606e895bcddad53722ead70cb377\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.301658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d71eb1a28a9e5c1e4bb6ce183a331460-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal\" (UID: \"d71eb1a28a9e5c1e4bb6ce183a331460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.322671 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.456692 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.424232 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.630519 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.478390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.630519 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.483820 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" Jul 08 17:19:10.630519 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.524819 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.630519 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.625406 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.852714 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.725883 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.852714 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.826444 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:10.852714 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.839586 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 17:19:10.852714 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.839736 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:10.927246 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.932812 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:14:10 +0000 UTC" deadline="2028-02-18 23:10:17.591030712 +0000 UTC" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.932839 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14165h51m6.658194262s" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:10.939767 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.014312 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.017133 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.017165 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.017180 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:19:11.084731 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:11.028263 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-141.ec2.internal\" not found" Jul 08 17:19:11.086400 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.086069 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:11.310396 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.100157 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" Jul 08 17:19:11.310396 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.115165 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:19:11.310396 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.116223 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" Jul 08 17:19:11.310396 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.126534 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:19:11.310396 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.252308 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:11.480751 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:11.363801 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71eb1a28a9e5c1e4bb6ce183a331460.slice/crio-ad53d0b14bd42720e90d2ac601e55db0a4623b54cf39f9dffe2ba0b6e79e040b WatchSource:0}: Error finding container ad53d0b14bd42720e90d2ac601e55db0a4623b54cf39f9dffe2ba0b6e79e040b: Status 404 returned error can't find the container with id ad53d0b14bd42720e90d2ac601e55db0a4623b54cf39f9dffe2ba0b6e79e040b Jul 08 17:19:11.480751 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:11.364160 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b21606e895bcddad53722ead70cb377.slice/crio-e8ad5e30f2b898fd7175c4056615fcdc712a3a400e9eae9f5db727b6c7b43ea5 WatchSource:0}: Error finding container e8ad5e30f2b898fd7175c4056615fcdc712a3a400e9eae9f5db727b6c7b43ea5: Status 404 returned error can't find the container with id e8ad5e30f2b898fd7175c4056615fcdc712a3a400e9eae9f5db727b6c7b43ea5 Jul 08 17:19:11.480751 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.370286 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:19:11.715973 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.684672 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.882708 2578 apiserver.go:52] "Watching apiserver" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.892445 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.894134 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-fwqpx","openshift-network-diagnostics/network-check-target-7wrzw","openshift-ovn-kubernetes/ovnkube-node-ngt8k","kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j","openshift-cluster-node-tuning-operator/tuned-x6nb5","openshift-dns/node-resolver-8l29s","openshift-multus/multus-ssstj","openshift-network-operator/iptables-alerter-zzhbs","kube-system/global-pull-secret-syncer-cnw5g","kube-system/konnectivity-agent-2npq6","openshift-image-registry/node-ca-vzffn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal","openshift-multus/multus-additional-cni-plugins-mjv4j"] Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.896348 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:11.896419 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.897460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.898621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.899839 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.900047 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.900077 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.900229 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b4qdq\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.900623 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.900770 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.900905 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.901417 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.902865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.903641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.905905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ssstj" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906394 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906621 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906681 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906711 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906729 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906875 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906913 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dghgk\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906975 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jzw72\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906984 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906914 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.907015 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.906916 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.907162 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l68k6\"" Jul 08 17:19:11.940682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.907506 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:11.907590 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.907689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4c4dq\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.907696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.907804 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.907693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.907839 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.908081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5kv99\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.908389 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.908549 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.908666 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.908943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:11.909057 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.909609 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p567b\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.911691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.912355 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.913137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.913890 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.914157 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bhbhr\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.914228 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915512 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915569 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915621 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915754 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d6gwx\"" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a37ad3a8-2873-4048-9539-f94e08b4276c-kubelet-config\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-registration-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:11.942813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-etc-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.915984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-node-log\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6db8fec-cdec-4cab-ac55-d121f13b8800-agent-certs\") pod \"konnectivity-agent-2npq6\" (UID: \"d6db8fec-cdec-4cab-ac55-d121f13b8800\") " pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovnkube-config\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x65gm\" (UniqueName: \"kubernetes.io/projected/57c09f25-3a84-468d-859a-4aeb151c5cfb-kube-api-access-x65gm\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-os-release\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916104 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-device-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2lqm\" (UniqueName: \"kubernetes.io/projected/f2c79348-b90e-44b8-a383-5fca7032433d-kube-api-access-s2lqm\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-kubelet\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-slash\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-var-lib-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-socket-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-log-socket\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.944894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-env-overrides\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-sys-fs\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a37ad3a8-2873-4048-9539-f94e08b4276c-dbus\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-run-netns\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovnkube-script-lib\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-system-cni-dir\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-cnibin\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcr2p\" (UniqueName: \"kubernetes.io/projected/643d6398-c6c4-4150-84a1-ad69d828dea4-kube-api-access-fcr2p\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6db8fec-cdec-4cab-ac55-d121f13b8800-konnectivity-ca\") pod \"konnectivity-agent-2npq6\" (UID: \"d6db8fec-cdec-4cab-ac55-d121f13b8800\") " pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-systemd\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-ovn\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-cni-netd\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.945865 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-systemd-units\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.947281 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-cni-bin\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.947281 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovn-node-metrics-cert\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:11.947281 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.947281 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.916686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:11.947281 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.936286 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nttcc" Jul 08 17:19:11.947281 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:11.943694 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nttcc" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.001484 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.015511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" event={"ID":"d71eb1a28a9e5c1e4bb6ce183a331460","Type":"ContainerStarted","Data":"ad53d0b14bd42720e90d2ac601e55db0a4623b54cf39f9dffe2ba0b6e79e040b"} Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.016632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" event={"ID":"1b21606e895bcddad53722ead70cb377","Type":"ContainerStarted","Data":"e8ad5e30f2b898fd7175c4056615fcdc712a3a400e9eae9f5db727b6c7b43ea5"} Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.017889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysconfig\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.017912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysctl-conf\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.017933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-systemd-units\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.017949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovn-node-metrics-cert\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.017968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-k8s-cni-cncf-io\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.017984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-multus-certs\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-systemd-units\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-iptables-alerter-script\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a37ad3a8-2873-4048-9539-f94e08b4276c-kubelet-config\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-registration-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db700a06-51a0-4985-baca-3e793ce9700b-multus-daemon-config\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a37ad3a8-2873-4048-9539-f94e08b4276c-kubelet-config\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-systemd\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-tuned\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.125877 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-registration-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-node-log\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-netns\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6db8fec-cdec-4cab-ac55-d121f13b8800-agent-certs\") pod \"konnectivity-agent-2npq6\" (UID: \"d6db8fec-cdec-4cab-ac55-d121f13b8800\") " pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018341 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-node-log\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovnkube-config\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x65gm\" (UniqueName: \"kubernetes.io/projected/57c09f25-3a84-468d-859a-4aeb151c5cfb-kube-api-access-x65gm\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-device-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmcbj\" (UniqueName: \"kubernetes.io/projected/788d0e28-8483-4168-bcba-4ea312a48c60-kube-api-access-pmcbj\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-kubernetes\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdsf5\" (UniqueName: \"kubernetes.io/projected/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-kube-api-access-jdsf5\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a846c6d-9a94-452e-8097-b893b996e20e-serviceca\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018488 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-device-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-slash\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.126990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-var-lib-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-cnibin\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-slash\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-os-release\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018656 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-var-lib-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-hostroot\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c99ae904-7b63-4095-8f36-fc81fad48a13-hosts-file\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-lib-modules\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd36a8f9-41c8-4a34-a92d-df54492a3754-tmp\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-log-socket\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-kubelet\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db700a06-51a0-4985-baca-3e793ce9700b-cni-binary-copy\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-log-socket\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a37ad3a8-2873-4048-9539-f94e08b4276c-dbus\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018902 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovnkube-config\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-run-netns\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.127899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.018978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-system-cni-dir\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.019009 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcr2p\" (UniqueName: \"kubernetes.io/projected/643d6398-c6c4-4150-84a1-ad69d828dea4-kube-api-access-fcr2p\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019027 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a37ad3a8-2873-4048-9539-f94e08b4276c-dbus\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-system-cni-dir\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-run-netns\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-run\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.019075 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret podName:a37ad3a8-2873-4048-9539-f94e08b4276c nodeName:}" failed. No retries permitted until 2026-07-08 17:19:12.519052872 +0000 UTC m=+2.978265386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret") pod "global-pull-secret-syncer-cnw5g" (UID: "a37ad3a8-2873-4048-9539-f94e08b4276c") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6db8fec-cdec-4cab-ac55-d121f13b8800-konnectivity-ca\") pod \"konnectivity-agent-2npq6\" (UID: \"d6db8fec-cdec-4cab-ac55-d121f13b8800\") " pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-ovn\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysctl-d\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-ovn\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-sys\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.128550 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvwv6\" (UniqueName: \"kubernetes.io/projected/dd36a8f9-41c8-4a34-a92d-df54492a3754-kube-api-access-qvwv6\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-cni-bin\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-cni-bin\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-etc-kubernetes\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-host-slash\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7rp\" (UniqueName: \"kubernetes.io/projected/6a846c6d-9a94-452e-8097-b893b996e20e-kube-api-access-kh7rp\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019584 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-etc-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019626 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.129140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-var-lib-kubelet\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019654 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-etc-openvswitch\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6db8fec-cdec-4cab-ac55-d121f13b8800-konnectivity-ca\") pod \"konnectivity-agent-2npq6\" (UID: \"d6db8fec-cdec-4cab-ac55-d121f13b8800\") " pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-os-release\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2lqm\" (UniqueName: \"kubernetes.io/projected/f2c79348-b90e-44b8-a383-5fca7032433d-kube-api-access-s2lqm\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-os-release\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-host\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-kubelet\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019878 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-kubelet\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-socket-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-cni-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-cni-multus\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.019981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a846c6d-9a94-452e-8097-b893b996e20e-host\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-env-overrides\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-socket-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.129652 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-sys-fs\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020063 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-system-cni-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-cni-bin\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-conf-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020117 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f2c79348-b90e-44b8-a383-5fca7032433d-sys-fs\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovnkube-script-lib\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020163 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-cnibin\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjlv7\" (UniqueName: \"kubernetes.io/projected/db700a06-51a0-4985-baca-3e793ce9700b-kube-api-access-vjlv7\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c99ae904-7b63-4095-8f36-fc81fad48a13-tmp-dir\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/643d6398-c6c4-4150-84a1-ad69d828dea4-cnibin\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq8np\" (UniqueName: \"kubernetes.io/projected/c99ae904-7b63-4095-8f36-fc81fad48a13-kube-api-access-xq8np\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/643d6398-c6c4-4150-84a1-ad69d828dea4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-systemd\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-cni-netd\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-env-overrides\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-run-systemd\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-socket-dir-parent\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020421 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57c09f25-3a84-468d-859a-4aeb151c5cfb-host-cni-netd\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-modprobe-d\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.020646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovnkube-script-lib\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.022043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57c09f25-3a84-468d-859a-4aeb151c5cfb-ovn-node-metrics-cert\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.022127 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6db8fec-cdec-4cab-ac55-d121f13b8800-agent-certs\") pod \"konnectivity-agent-2npq6\" (UID: \"d6db8fec-cdec-4cab-ac55-d121f13b8800\") " pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.029943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcr2p\" (UniqueName: \"kubernetes.io/projected/643d6398-c6c4-4150-84a1-ad69d828dea4-kube-api-access-fcr2p\") pod \"multus-additional-cni-plugins-mjv4j\" (UID: \"643d6398-c6c4-4150-84a1-ad69d828dea4\") " pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.030441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x65gm\" (UniqueName: \"kubernetes.io/projected/57c09f25-3a84-468d-859a-4aeb151c5cfb-kube-api-access-x65gm\") pod \"ovnkube-node-ngt8k\" (UID: \"57c09f25-3a84-468d-859a-4aeb151c5cfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.031020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2lqm\" (UniqueName: \"kubernetes.io/projected/f2c79348-b90e-44b8-a383-5fca7032433d-kube-api-access-s2lqm\") pod \"aws-ebs-csi-driver-node-tkq5j\" (UID: \"f2c79348-b90e-44b8-a383-5fca7032433d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.121722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-iptables-alerter-script\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.121753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db700a06-51a0-4985-baca-3e793ce9700b-multus-daemon-config\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.121770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-systemd\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.121794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-tuned\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.121889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-systemd\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.121905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-netns\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.130784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.121950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmcbj\" (UniqueName: \"kubernetes.io/projected/788d0e28-8483-4168-bcba-4ea312a48c60-kube-api-access-pmcbj\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.121974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-kubernetes\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdsf5\" (UniqueName: \"kubernetes.io/projected/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-kube-api-access-jdsf5\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-netns\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a846c6d-9a94-452e-8097-b893b996e20e-serviceca\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122118 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-kubernetes\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-cnibin\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-os-release\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-hostroot\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c99ae904-7b63-4095-8f36-fc81fad48a13-hosts-file\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-lib-modules\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122291 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-hostroot\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd36a8f9-41c8-4a34-a92d-df54492a3754-tmp\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-kubelet\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db700a06-51a0-4985-baca-3e793ce9700b-cni-binary-copy\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-run\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysctl-d\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-sys\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.131412 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/db700a06-51a0-4985-baca-3e793ce9700b-multus-daemon-config\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-kubelet\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-iptables-alerter-script\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-os-release\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvwv6\" (UniqueName: \"kubernetes.io/projected/dd36a8f9-41c8-4a34-a92d-df54492a3754-kube-api-access-qvwv6\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-etc-kubernetes\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-host-slash\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c99ae904-7b63-4095-8f36-fc81fad48a13-hosts-file\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a846c6d-9a94-452e-8097-b893b996e20e-serviceca\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7rp\" (UniqueName: \"kubernetes.io/projected/6a846c6d-9a94-452e-8097-b893b996e20e-kube-api-access-kh7rp\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-var-lib-kubelet\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-host\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-cni-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122845 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-etc-kubernetes\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-cni-multus\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a846c6d-9a94-452e-8097-b893b996e20e-host\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-system-cni-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-cni-bin\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-conf-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysctl-d\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjlv7\" (UniqueName: \"kubernetes.io/projected/db700a06-51a0-4985-baca-3e793ce9700b-kube-api-access-vjlv7\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123058 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db700a06-51a0-4985-baca-3e793ce9700b-cni-binary-copy\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c99ae904-7b63-4095-8f36-fc81fad48a13-tmp-dir\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq8np\" (UniqueName: \"kubernetes.io/projected/c99ae904-7b63-4095-8f36-fc81fad48a13-kube-api-access-xq8np\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-run\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-socket-dir-parent\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-cni-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.122891 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-host-slash\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-var-lib-kubelet\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-lib-modules\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-cni-bin\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-host\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-conf-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123312 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-multus-socket-dir-parent\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.132643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-var-lib-cni-multus\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123079 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-sys\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123591 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c99ae904-7b63-4095-8f36-fc81fad48a13-tmp-dir\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-system-cni-dir\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.124563 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.124638 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs podName:788d0e28-8483-4168-bcba-4ea312a48c60 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:12.624619071 +0000 UTC m=+3.083831603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs") pod "network-metrics-daemon-fwqpx" (UID: "788d0e28-8483-4168-bcba-4ea312a48c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.125119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd36a8f9-41c8-4a34-a92d-df54492a3754-tmp\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-modprobe-d\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-modprobe-d\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.123209 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a846c6d-9a94-452e-8097-b893b996e20e-host\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.127641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysconfig\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.127676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysctl-conf\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.127711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-k8s-cni-cncf-io\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.127736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysconfig\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.127738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-multus-certs\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.127776 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-multus-certs\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.127777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-host-run-k8s-cni-cncf-io\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.127824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-sysctl-conf\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.133351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.128554 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db700a06-51a0-4985-baca-3e793ce9700b-cnibin\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.134012 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.129483 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd36a8f9-41c8-4a34-a92d-df54492a3754-etc-tuned\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.145855 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.145875 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.145885 2578 projected.go:196] Error preparing data for projected volume kube-api-access-l9p4p for pod openshift-network-diagnostics/network-check-target-7wrzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.145959 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p podName:a8171d08-14f1-4a39-853e-413e6039fa50 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:12.645944158 +0000 UTC m=+3.105156693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l9p4p" (UniqueName: "kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p") pod "network-check-target-7wrzw" (UID: "a8171d08-14f1-4a39-853e-413e6039fa50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.146037 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmcbj\" (UniqueName: \"kubernetes.io/projected/788d0e28-8483-4168-bcba-4ea312a48c60-kube-api-access-pmcbj\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.148100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvwv6\" (UniqueName: \"kubernetes.io/projected/dd36a8f9-41c8-4a34-a92d-df54492a3754-kube-api-access-qvwv6\") pod \"tuned-x6nb5\" (UID: \"dd36a8f9-41c8-4a34-a92d-df54492a3754\") " pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.148378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjlv7\" (UniqueName: \"kubernetes.io/projected/db700a06-51a0-4985-baca-3e793ce9700b-kube-api-access-vjlv7\") pod \"multus-ssstj\" (UID: \"db700a06-51a0-4985-baca-3e793ce9700b\") " pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.148485 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdsf5\" (UniqueName: \"kubernetes.io/projected/f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa-kube-api-access-jdsf5\") pod \"iptables-alerter-zzhbs\" (UID: \"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa\") " pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.150637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7rp\" (UniqueName: \"kubernetes.io/projected/6a846c6d-9a94-452e-8097-b893b996e20e-kube-api-access-kh7rp\") pod \"node-ca-vzffn\" (UID: \"6a846c6d-9a94-452e-8097-b893b996e20e\") " pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.151544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq8np\" (UniqueName: \"kubernetes.io/projected/c99ae904-7b63-4095-8f36-fc81fad48a13-kube-api-access-xq8np\") pod \"node-resolver-8l29s\" (UID: \"c99ae904-7b63-4095-8f36-fc81fad48a13\") " pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.209876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.217226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:12.218177 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6db8fec_cdec_4cab_ac55_d121f13b8800.slice/crio-00895f7790715ed83fe293384a060c06af13fbcc56013e924e31865fd7743cc8 WatchSource:0}: Error finding container 00895f7790715ed83fe293384a060c06af13fbcc56013e924e31865fd7743cc8: Status 404 returned error can't find the container with id 00895f7790715ed83fe293384a060c06af13fbcc56013e924e31865fd7743cc8 Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.226003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:12.226312 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c09f25_3a84_468d_859a_4aeb151c5cfb.slice/crio-5821718163e71910872be20e30dbee8ca34682adc1ecd5d58fb8896764e83b1e WatchSource:0}: Error finding container 5821718163e71910872be20e30dbee8ca34682adc1ecd5d58fb8896764e83b1e: Status 404 returned error can't find the container with id 5821718163e71910872be20e30dbee8ca34682adc1ecd5d58fb8896764e83b1e Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.230441 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.235712 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" Jul 08 17:19:12.250623 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:12.240051 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643d6398_c6c4_4150_84a1_ad69d828dea4.slice/crio-6f7461140a133d309169cf61a1aa389063217738c51684221625bed7c43ec500 WatchSource:0}: Error finding container 6f7461140a133d309169cf61a1aa389063217738c51684221625bed7c43ec500: Status 404 returned error can't find the container with id 6f7461140a133d309169cf61a1aa389063217738c51684221625bed7c43ec500 Jul 08 17:19:12.389987 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.259412 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zzhbs" Jul 08 17:19:12.389987 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.265034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ssstj" Jul 08 17:19:12.389987 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.270961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8l29s" Jul 08 17:19:12.389987 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:12.273733 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e5d60c_e1fb_4b6d_8ffd_09ea2b8f79fa.slice/crio-5731c7261f7d87823803a6cee4c05fe3274feabc34c2274d78fec4ef6fcb0cc2 WatchSource:0}: Error finding container 5731c7261f7d87823803a6cee4c05fe3274feabc34c2274d78fec4ef6fcb0cc2: Status 404 returned error can't find the container with id 5731c7261f7d87823803a6cee4c05fe3274feabc34c2274d78fec4ef6fcb0cc2 Jul 08 17:19:12.389987 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.275046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vzffn" Jul 08 17:19:12.389987 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:12.278704 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb700a06_51a0_4985_baca_3e793ce9700b.slice/crio-ee973724fea480dc5bc3fca097a17df004d2028396fee5d87cfca5e357c1933b WatchSource:0}: Error finding container ee973724fea480dc5bc3fca097a17df004d2028396fee5d87cfca5e357c1933b: Status 404 returned error can't find the container with id ee973724fea480dc5bc3fca097a17df004d2028396fee5d87cfca5e357c1933b Jul 08 17:19:12.389987 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:12.292593 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99ae904_7b63_4095_8f36_fc81fad48a13.slice/crio-09995347278c0bb3cf589764d5f540897dd66e09fc6a1b72c29c589c5e1a61e6 WatchSource:0}: Error finding container 09995347278c0bb3cf589764d5f540897dd66e09fc6a1b72c29c589c5e1a61e6: Status 404 returned error can't find the container with id 09995347278c0bb3cf589764d5f540897dd66e09fc6a1b72c29c589c5e1a61e6 Jul 08 17:19:12.389987 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:12.293021 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a846c6d_9a94_452e_8097_b893b996e20e.slice/crio-3e10b935844261049d8246e83c4e1a4931650fcd906dfb808fbdac06bd3849a8 WatchSource:0}: Error finding container 3e10b935844261049d8246e83c4e1a4931650fcd906dfb808fbdac06bd3849a8: Status 404 returned error can't find the container with id 3e10b935844261049d8246e83c4e1a4931650fcd906dfb808fbdac06bd3849a8 Jul 08 17:19:12.591646 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.531469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:12.591646 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.531672 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:12.591646 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.531744 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret podName:a37ad3a8-2873-4048-9539-f94e08b4276c nodeName:}" failed. No retries permitted until 2026-07-08 17:19:13.531723873 +0000 UTC m=+3.990936392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret") pod "global-pull-secret-syncer-cnw5g" (UID: "a37ad3a8-2873-4048-9539-f94e08b4276c") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:12.682194 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.632656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:12.682194 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.632798 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:12.682194 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.632898 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs podName:788d0e28-8483-4168-bcba-4ea312a48c60 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:13.632875112 +0000 UTC m=+4.092087626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs") pod "network-metrics-daemon-fwqpx" (UID: "788d0e28-8483-4168-bcba-4ea312a48c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:12.771784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.733046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:12.771784 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.733322 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:12.771784 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.733347 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:12.771784 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.733362 2578 projected.go:196] Error preparing data for projected volume kube-api-access-l9p4p for pod openshift-network-diagnostics/network-check-target-7wrzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:12.771784 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:12.733424 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p podName:a8171d08-14f1-4a39-853e-413e6039fa50 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:13.733405384 +0000 UTC m=+4.192617903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9p4p" (UniqueName: "kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p") pod "network-check-target-7wrzw" (UID: "a8171d08-14f1-4a39-853e-413e6039fa50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:12.947033 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.946948 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:14:12 +0000 UTC" deadline="2028-02-22 16:00:16.248557104 +0000 UTC" Jul 08 17:19:12.947033 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:12.947014 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14254h41m3.301547573s" Jul 08 17:19:13.020037 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.019996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" event={"ID":"643d6398-c6c4-4150-84a1-ad69d828dea4","Type":"ContainerStarted","Data":"6f7461140a133d309169cf61a1aa389063217738c51684221625bed7c43ec500"} Jul 08 17:19:13.021395 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.021370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"5821718163e71910872be20e30dbee8ca34682adc1ecd5d58fb8896764e83b1e"} Jul 08 17:19:13.022802 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.022740 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2npq6" event={"ID":"d6db8fec-cdec-4cab-ac55-d121f13b8800","Type":"ContainerStarted","Data":"00895f7790715ed83fe293384a060c06af13fbcc56013e924e31865fd7743cc8"} Jul 08 17:19:13.024407 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.024378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vzffn" event={"ID":"6a846c6d-9a94-452e-8097-b893b996e20e","Type":"ContainerStarted","Data":"3e10b935844261049d8246e83c4e1a4931650fcd906dfb808fbdac06bd3849a8"} Jul 08 17:19:13.026526 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.026502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" event={"ID":"dd36a8f9-41c8-4a34-a92d-df54492a3754","Type":"ContainerStarted","Data":"90a34ab559d8d6bbf0c73d515e136d911de9df2e08b8aeb37c49a8a6bc2790da"} Jul 08 17:19:13.029266 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.029241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" event={"ID":"f2c79348-b90e-44b8-a383-5fca7032433d","Type":"ContainerStarted","Data":"d605cc3acabea11969f8072961014f78de81239707fa3784db6e04d60ee1721c"} Jul 08 17:19:13.033299 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.033254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8l29s" event={"ID":"c99ae904-7b63-4095-8f36-fc81fad48a13","Type":"ContainerStarted","Data":"09995347278c0bb3cf589764d5f540897dd66e09fc6a1b72c29c589c5e1a61e6"} Jul 08 17:19:13.035528 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.035505 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ssstj" event={"ID":"db700a06-51a0-4985-baca-3e793ce9700b","Type":"ContainerStarted","Data":"ee973724fea480dc5bc3fca097a17df004d2028396fee5d87cfca5e357c1933b"} Jul 08 17:19:13.037312 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.037286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zzhbs" event={"ID":"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa","Type":"ContainerStarted","Data":"5731c7261f7d87823803a6cee4c05fe3274feabc34c2274d78fec4ef6fcb0cc2"} Jul 08 17:19:13.541894 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.539990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:13.541894 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:13.540158 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:13.541894 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:13.540228 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret podName:a37ad3a8-2873-4048-9539-f94e08b4276c nodeName:}" failed. No retries permitted until 2026-07-08 17:19:15.540208879 +0000 UTC m=+5.999421394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret") pod "global-pull-secret-syncer-cnw5g" (UID: "a37ad3a8-2873-4048-9539-f94e08b4276c") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:13.641210 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.641165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:13.641407 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:13.641385 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:13.641506 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:13.641458 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs podName:788d0e28-8483-4168-bcba-4ea312a48c60 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:15.64143661 +0000 UTC m=+6.100649127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs") pod "network-metrics-daemon-fwqpx" (UID: "788d0e28-8483-4168-bcba-4ea312a48c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:13.746626 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.742544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:13.746626 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:13.742722 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:13.746626 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:13.742741 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:13.746626 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:13.742754 2578 projected.go:196] Error preparing data for projected volume kube-api-access-l9p4p for pod openshift-network-diagnostics/network-check-target-7wrzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:13.746626 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:13.742826 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p podName:a8171d08-14f1-4a39-853e-413e6039fa50 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:15.742806221 +0000 UTC m=+6.202018735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9p4p" (UniqueName: "kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p") pod "network-check-target-7wrzw" (UID: "a8171d08-14f1-4a39-853e-413e6039fa50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:13.947927 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.947814 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:14:12 +0000 UTC" deadline="2028-02-11 08:56:51.609317007 +0000 UTC" Jul 08 17:19:13.947927 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:13.947871 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13983h37m37.661466059s" Jul 08 17:19:14.010471 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:14.009014 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:14.010471 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:14.009169 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:14.010471 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:14.009268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:14.010471 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:14.009350 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:14.010471 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:14.009407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:14.010471 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:14.009470 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:15.557851 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:15.557808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:15.558376 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:15.557997 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:15.558376 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:15.558065 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret podName:a37ad3a8-2873-4048-9539-f94e08b4276c nodeName:}" failed. No retries permitted until 2026-07-08 17:19:19.558048238 +0000 UTC m=+10.017260766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret") pod "global-pull-secret-syncer-cnw5g" (UID: "a37ad3a8-2873-4048-9539-f94e08b4276c") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:15.658763 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:15.658674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:15.668029 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:15.663231 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:15.668029 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:15.663339 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs podName:788d0e28-8483-4168-bcba-4ea312a48c60 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:19.663312864 +0000 UTC m=+10.122525398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs") pod "network-metrics-daemon-fwqpx" (UID: "788d0e28-8483-4168-bcba-4ea312a48c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:15.760187 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:15.760137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:15.760334 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:15.760314 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:15.760391 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:15.760340 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:15.760391 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:15.760351 2578 projected.go:196] Error preparing data for projected volume kube-api-access-l9p4p for pod openshift-network-diagnostics/network-check-target-7wrzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:15.760502 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:15.760414 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p podName:a8171d08-14f1-4a39-853e-413e6039fa50 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:19.760396548 +0000 UTC m=+10.219609061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9p4p" (UniqueName: "kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p") pod "network-check-target-7wrzw" (UID: "a8171d08-14f1-4a39-853e-413e6039fa50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:16.007025 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:16.006949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:16.007025 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:16.006980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:16.007025 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:16.006987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:16.007269 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:16.007076 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:16.007269 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:16.007169 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:16.007376 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:16.007257 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:18.005618 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:18.005586 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:18.005618 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:18.005611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:18.006125 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:18.005586 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:18.006125 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:18.005731 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:18.006125 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:18.005822 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:18.006125 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:18.005939 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:19.590684 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:19.590644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:19.591172 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:19.590866 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:19.591172 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:19.590932 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret podName:a37ad3a8-2873-4048-9539-f94e08b4276c nodeName:}" failed. No retries permitted until 2026-07-08 17:19:27.590912734 +0000 UTC m=+18.050125267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret") pod "global-pull-secret-syncer-cnw5g" (UID: "a37ad3a8-2873-4048-9539-f94e08b4276c") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:19.691581 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:19.691525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:19.691761 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:19.691723 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:19.691824 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:19.691797 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs podName:788d0e28-8483-4168-bcba-4ea312a48c60 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:27.691777059 +0000 UTC m=+18.150989571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs") pod "network-metrics-daemon-fwqpx" (UID: "788d0e28-8483-4168-bcba-4ea312a48c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:19.792368 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:19.792335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:19.792990 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:19.792963 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:19.793121 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:19.792997 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:19.793121 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:19.793013 2578 projected.go:196] Error preparing data for projected volume kube-api-access-l9p4p for pod openshift-network-diagnostics/network-check-target-7wrzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:19.793121 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:19.793098 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p podName:a8171d08-14f1-4a39-853e-413e6039fa50 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:27.793080171 +0000 UTC m=+18.252292697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9p4p" (UniqueName: "kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p") pod "network-check-target-7wrzw" (UID: "a8171d08-14f1-4a39-853e-413e6039fa50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:20.008142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:20.007376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:20.008142 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:20.007499 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:20.008142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:20.007899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:20.008142 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:20.007990 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:20.008142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:20.008049 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:20.008142 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:20.008111 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:22.005906 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:22.005866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:22.006319 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:22.006005 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:22.006319 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:22.005875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:22.006319 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:22.006103 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:22.006319 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:22.005865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:22.006319 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:22.006205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:24.006534 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:24.006453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:24.006923 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:24.006580 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:24.006923 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:24.006652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:24.006923 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:24.006736 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:24.006923 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:24.006453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:24.006923 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:24.006810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:26.005670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:26.005630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:26.006123 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:26.005630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:26.006123 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:26.005751 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:26.006123 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:26.005646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:26.006123 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:26.005866 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:26.006123 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:26.005966 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:27.652547 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:27.652510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:27.653077 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:27.652669 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:27.653077 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:27.652730 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret podName:a37ad3a8-2873-4048-9539-f94e08b4276c nodeName:}" failed. No retries permitted until 2026-07-08 17:19:43.652712523 +0000 UTC m=+34.111925046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret") pod "global-pull-secret-syncer-cnw5g" (UID: "a37ad3a8-2873-4048-9539-f94e08b4276c") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:27.753084 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:27.753036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:27.753249 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:27.753219 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:27.753326 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:27.753304 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs podName:788d0e28-8483-4168-bcba-4ea312a48c60 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:43.753283223 +0000 UTC m=+34.212495742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs") pod "network-metrics-daemon-fwqpx" (UID: "788d0e28-8483-4168-bcba-4ea312a48c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:27.854017 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:27.853978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:27.854203 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:27.854128 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:27.854203 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:27.854149 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:27.854203 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:27.854162 2578 projected.go:196] Error preparing data for projected volume kube-api-access-l9p4p for pod openshift-network-diagnostics/network-check-target-7wrzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:27.854370 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:27.854227 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p podName:a8171d08-14f1-4a39-853e-413e6039fa50 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:43.854208333 +0000 UTC m=+34.313420861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9p4p" (UniqueName: "kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p") pod "network-check-target-7wrzw" (UID: "a8171d08-14f1-4a39-853e-413e6039fa50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:28.008414 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:28.008336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:28.008531 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:28.008416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:28.008531 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:28.008426 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:28.008531 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:28.008443 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:28.008627 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:28.008527 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:28.008627 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:28.008584 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:30.008207 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:30.008182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:30.008662 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:30.008283 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:30.008662 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:30.008290 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:30.008662 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:30.008408 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:30.008662 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:30.008458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:30.008662 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:30.008538 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:32.010867 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.010823 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:32.011240 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:32.010969 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:32.011689 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.011333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:32.011689 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:32.011422 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:32.011689 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.011469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:32.011689 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:32.011539 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:32.087713 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.087672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" event={"ID":"dd36a8f9-41c8-4a34-a92d-df54492a3754","Type":"ContainerStarted","Data":"9dd03473df87adcf00a0e75a78015b9ac7b71f2dd04d702c6f6227580b1e6ced"} Jul 08 17:19:32.093555 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.093531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" event={"ID":"1b21606e895bcddad53722ead70cb377","Type":"ContainerStarted","Data":"7b7a9f09755a95abfe9df2e24dec8c33e62ba60cd8c7d807244c1a370b84f872"} Jul 08 17:19:32.095433 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.095411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ssstj" event={"ID":"db700a06-51a0-4985-baca-3e793ce9700b","Type":"ContainerStarted","Data":"f61357a2542b4d39920256fc41d83f53efb60a43b329c036984beabc5d7cf8f0"} Jul 08 17:19:32.101304 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.101274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"2ca3caf9abc5e663eea3678d0066f1bba09f7fb74833fc161b212d6c1ae8c9c2"} Jul 08 17:19:32.101394 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.101359 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"101eeb4cf7b5561c03e11077698b709fcd1d1584c2e77e634834ecd636a7fd57"} Jul 08 17:19:32.106259 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.106207 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x6nb5" podStartSLOduration=2.587371301 podStartE2EDuration="22.106189575s" totalImagesPullingTime="19.518818274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:32.105427585 +0000 UTC m=+22.564640117" watchObservedRunningTime="2026-07-08 17:19:32.106189575 +0000 UTC m=+22.565402108" Jul 08 17:19:32.122955 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.122909 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ssstj" podStartSLOduration=2.5687067089999998 podStartE2EDuration="22.122845765s" totalImagesPullingTime="19.554139056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:32.122285026 +0000 UTC m=+22.581497559" watchObservedRunningTime="2026-07-08 17:19:32.122845765 +0000 UTC m=+22.582058297" Jul 08 17:19:32.141926 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:32.141884 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-141.ec2.internal" podStartSLOduration=21.141869009 podStartE2EDuration="21.141869009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:32.141455309 +0000 UTC m=+22.600667842" watchObservedRunningTime="2026-07-08 17:19:32.141869009 +0000 UTC m=+22.601081532" Jul 08 17:19:33.104728 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.104652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2npq6" event={"ID":"d6db8fec-cdec-4cab-ac55-d121f13b8800","Type":"ContainerStarted","Data":"4ae0668654114f2a607458e442539605708843536d3276cf5d0df512c0ee1a02"} Jul 08 17:19:33.106056 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.106033 2578 generic.go:356] "Generic (PLEG): container finished" podID="d71eb1a28a9e5c1e4bb6ce183a331460" containerID="4e2c7b3e482d8dd6047fd01b48b2b1ea27e19d3fcb287bec816b7ae920d1416b" exitCode=0 Jul 08 17:19:33.106171 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.106099 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" event={"ID":"d71eb1a28a9e5c1e4bb6ce183a331460","Type":"ContainerDied","Data":"4e2c7b3e482d8dd6047fd01b48b2b1ea27e19d3fcb287bec816b7ae920d1416b"} Jul 08 17:19:33.107537 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.107496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vzffn" event={"ID":"6a846c6d-9a94-452e-8097-b893b996e20e","Type":"ContainerStarted","Data":"3ed2e541e3ba344bea17090bb4841d7efcf6ceb0bf635756777f9b1e78c82e60"} Jul 08 17:19:33.109006 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.108986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" event={"ID":"f2c79348-b90e-44b8-a383-5fca7032433d","Type":"ContainerStarted","Data":"8d401621c7ef81c1a2326bb1300e031a2e421b96e586ab2dc44e856a6ccceffa"} Jul 08 17:19:33.110284 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.110261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8l29s" event={"ID":"c99ae904-7b63-4095-8f36-fc81fad48a13","Type":"ContainerStarted","Data":"ec57087110ffe6001252cbc08be3d4255cabdffac0af74177d9a3bca71c27353"} Jul 08 17:19:33.111518 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.111494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zzhbs" event={"ID":"f0e5d60c-e1fb-4b6d-8ffd-09ea2b8f79fa","Type":"ContainerStarted","Data":"071d311aa0526bab9d3d20ee4123262c3a6693b9fdc9dc51d6118cbd50289982"} Jul 08 17:19:33.112822 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.112804 2578 generic.go:356] "Generic (PLEG): container finished" podID="643d6398-c6c4-4150-84a1-ad69d828dea4" containerID="e91d5b0e985da535975832d8ae06206a338cf67850ec1cf6e6aad6845002fa01" exitCode=0 Jul 08 17:19:33.112924 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.112888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" event={"ID":"643d6398-c6c4-4150-84a1-ad69d828dea4","Type":"ContainerDied","Data":"e91d5b0e985da535975832d8ae06206a338cf67850ec1cf6e6aad6845002fa01"} Jul 08 17:19:33.115924 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.115903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"abe7305ff6a4dcbff95e5015600fdd5645238b73c9bdccd7feacb9f82b89e7ee"} Jul 08 17:19:33.116017 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.115979 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"02d9486d9cf2c018e60b67cb7f9011fff192adc6a090026473d81d8f838d0434"} Jul 08 17:19:33.116073 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.116027 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"441c434237d8b8c7d022650c10adb251ec01739ced870c56d830058b29b8ec26"} Jul 08 17:19:33.116111 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.116081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"5677b903d1052fb97e52d05a6f7542b74a935fff0e4222101efa6a046d649c8b"} Jul 08 17:19:33.120186 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.120064 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2npq6" podStartSLOduration=7.317277343 podStartE2EDuration="23.120048608s" totalImagesPullingTime="15.802771265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:33.119467649 +0000 UTC m=+23.578680181" watchObservedRunningTime="2026-07-08 17:19:33.120048608 +0000 UTC m=+23.579261140" Jul 08 17:19:33.151270 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.151007 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8l29s" podStartSLOduration=3.667969809 podStartE2EDuration="23.150987721s" totalImagesPullingTime="19.483017912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:33.150378433 +0000 UTC m=+23.609590965" watchObservedRunningTime="2026-07-08 17:19:33.150987721 +0000 UTC m=+23.610200253" Jul 08 17:19:33.191230 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.191181 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vzffn" podStartSLOduration=7.462825255 podStartE2EDuration="23.191161125s" totalImagesPullingTime="15.72833587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:33.166550877 +0000 UTC m=+23.625763410" watchObservedRunningTime="2026-07-08 17:19:33.191161125 +0000 UTC m=+23.650373658" Jul 08 17:19:33.206116 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.206070 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zzhbs" podStartSLOduration=3.704831564 podStartE2EDuration="23.206055469s" totalImagesPullingTime="19.501223905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:33.205472964 +0000 UTC m=+23.664685496" watchObservedRunningTime="2026-07-08 17:19:33.206055469 +0000 UTC m=+23.665268000" Jul 08 17:19:33.840825 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.840803 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 17:19:33.996816 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.996608 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:19:33.840820272Z","UUID":"5f2ec19d-e059-4460-9c03-7e4966e092c1","Handler":null,"Name":"","Endpoint":""} Jul 08 17:19:33.999182 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.999160 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 17:19:33.999301 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:33.999201 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 17:19:34.010996 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:34.010966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:34.011127 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:34.011062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:34.011127 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:34.011076 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:34.011127 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:34.011086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:34.011230 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:34.011160 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:34.011264 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:34.011247 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:34.119621 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:34.119583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" event={"ID":"f2c79348-b90e-44b8-a383-5fca7032433d","Type":"ContainerStarted","Data":"d78cfbec7db9ae57b54bff48f1360a79ea8cd14c819c8a2d3919909428646f66"} Jul 08 17:19:34.121290 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:34.121258 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" event={"ID":"d71eb1a28a9e5c1e4bb6ce183a331460","Type":"ContainerStarted","Data":"69f5b6f15fa6dc768490f39ee923bb32f76a0b1628bcbd61db552c70cd5f5673"} Jul 08 17:19:34.140714 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:34.140673 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-141.ec2.internal" podStartSLOduration=23.140659819 podStartE2EDuration="23.140659819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:34.140410876 +0000 UTC m=+24.599623410" watchObservedRunningTime="2026-07-08 17:19:34.140659819 +0000 UTC m=+24.599872352" Jul 08 17:19:35.126382 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:35.126352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"74b0e2c14b178e179e65c260d7cd83f3c600dd787a7923299488d7461bb048b7"} Jul 08 17:19:35.774107 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:35.774073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:35.774717 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:35.774690 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:36.005747 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:36.005718 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:36.005937 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:36.005715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:36.005937 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:36.005847 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:36.006073 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:36.005932 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:36.006073 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:36.005718 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:36.006073 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:36.006044 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:36.130633 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:36.130594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" event={"ID":"f2c79348-b90e-44b8-a383-5fca7032433d","Type":"ContainerStarted","Data":"567d91c3fe56116b2926c2b7c8962906137c53619e8939ffcd643f73ea547b2c"} Jul 08 17:19:36.148605 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:36.148534 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tkq5j" podStartSLOduration=3.527193811 podStartE2EDuration="26.148519562s" totalImagesPullingTime="22.621325751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:36.148120718 +0000 UTC m=+26.607333261" watchObservedRunningTime="2026-07-08 17:19:36.148519562 +0000 UTC m=+26.607732094" Jul 08 17:19:37.137229 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:37.136996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" event={"ID":"57c09f25-3a84-468d-859a-4aeb151c5cfb","Type":"ContainerStarted","Data":"42b3411fde545483076db41fb435653851ae883155193212b2691a2979122547"} Jul 08 17:19:37.163974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:37.163926 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" podStartSLOduration=7.542541859 podStartE2EDuration="27.163910412s" totalImagesPullingTime="19.621368553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:37.163434216 +0000 UTC m=+27.622646748" watchObservedRunningTime="2026-07-08 17:19:37.163910412 +0000 UTC m=+27.623122946" Jul 08 17:19:38.005896 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.005848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:38.006069 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.005912 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:38.006069 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.005848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:38.006069 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:38.005994 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:38.006238 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:38.006093 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:38.006238 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:38.006175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:38.140121 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.140087 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:38.140551 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.140173 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:38.140551 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.140220 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:38.161622 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.161589 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:38.162041 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.162024 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:19:38.584128 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.584099 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:38.584256 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.584206 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 17:19:38.584680 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.584662 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2npq6" Jul 08 17:19:38.926753 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.926712 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cnw5g"] Jul 08 17:19:38.926946 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.926891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:38.927053 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:38.927030 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:38.928366 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.928342 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7wrzw"] Jul 08 17:19:38.928479 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.928431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:38.928518 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:38.928494 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:38.940056 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.940030 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fwqpx"] Jul 08 17:19:38.940161 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:38.940153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:38.940281 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:38.940257 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:41.005868 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:41.005813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:41.006470 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:41.005813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:41.006470 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:41.005954 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:41.006470 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:41.006055 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:41.006470 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:41.005825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:41.006470 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:41.006154 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:43.006368 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:43.006178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:43.006758 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:43.006185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:43.006758 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.006450 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fwqpx" podUID="788d0e28-8483-4168-bcba-4ea312a48c60" Jul 08 17:19:43.006758 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:43.006226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:43.006758 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.006522 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wrzw" podUID="a8171d08-14f1-4a39-853e-413e6039fa50" Jul 08 17:19:43.006758 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.006619 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cnw5g" podUID="a37ad3a8-2873-4048-9539-f94e08b4276c" Jul 08 17:19:43.151656 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:43.151625 2578 generic.go:356] "Generic (PLEG): container finished" podID="643d6398-c6c4-4150-84a1-ad69d828dea4" containerID="49bcc503029edfbc5d02c1e96ad55c4f32ec6df12168c42a7012fb4fe8146988" exitCode=0 Jul 08 17:19:43.151812 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:43.151676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" event={"ID":"643d6398-c6c4-4150-84a1-ad69d828dea4","Type":"ContainerDied","Data":"49bcc503029edfbc5d02c1e96ad55c4f32ec6df12168c42a7012fb4fe8146988"} Jul 08 17:19:43.677472 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:43.677438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:43.677671 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.677569 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:43.677671 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.677632 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret podName:a37ad3a8-2873-4048-9539-f94e08b4276c nodeName:}" failed. No retries permitted until 2026-07-08 17:20:15.677614781 +0000 UTC m=+66.136827298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret") pod "global-pull-secret-syncer-cnw5g" (UID: "a37ad3a8-2873-4048-9539-f94e08b4276c") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:19:43.778222 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:43.778196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:43.778348 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.778316 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:43.778380 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.778372 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs podName:788d0e28-8483-4168-bcba-4ea312a48c60 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:15.778355171 +0000 UTC m=+66.237567681 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs") pod "network-metrics-daemon-fwqpx" (UID: "788d0e28-8483-4168-bcba-4ea312a48c60") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:19:43.879445 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:43.879414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:43.879703 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.879554 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:19:43.879703 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.879570 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:19:43.879703 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.879580 2578 projected.go:196] Error preparing data for projected volume kube-api-access-l9p4p for pod openshift-network-diagnostics/network-check-target-7wrzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:43.879703 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:43.879639 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p podName:a8171d08-14f1-4a39-853e-413e6039fa50 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:15.879626021 +0000 UTC m=+66.338838532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l9p4p" (UniqueName: "kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p") pod "network-check-target-7wrzw" (UID: "a8171d08-14f1-4a39-853e-413e6039fa50") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:19:44.864155 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.864127 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-141.ec2.internal" event="NodeReady" Jul 08 17:19:44.864575 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.864257 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 17:19:44.901098 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.901064 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f75c4d5fc-84khb"] Jul 08 17:19:44.921871 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.921835 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6"] Jul 08 17:19:44.922145 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.922115 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:44.924640 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.924619 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 17:19:44.924755 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.924656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 17:19:44.924938 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.924924 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbqpz\"" Jul 08 17:19:44.925122 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.925110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 17:19:44.931358 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.931333 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 17:19:44.937778 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.937756 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zpcl8"] Jul 08 17:19:44.937915 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.937901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6" Jul 08 17:19:44.940727 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.940708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5t287\"" Jul 08 17:19:44.940904 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.940887 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:44.940986 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.940940 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:44.954711 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.954690 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t"] Jul 08 17:19:44.954834 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.954808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:44.959328 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.959275 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 17:19:44.960445 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.960425 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g47hd\"" Jul 08 17:19:44.960655 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.960638 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 17:19:44.960847 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.960646 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 17:19:44.960962 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.960696 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 17:19:44.967658 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.967599 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 17:19:44.968797 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.968782 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg"] Jul 08 17:19:44.968946 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.968930 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:44.971078 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.971057 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 17:19:44.971172 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.971120 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 17:19:44.971339 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.971322 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:44.971409 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.971368 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wlzcb\"" Jul 08 17:19:44.971717 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.971702 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:44.987047 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.987025 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h"] Jul 08 17:19:44.987159 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.987103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:44.989569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.989548 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t94t7\"" Jul 08 17:19:44.989569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.989560 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 17:19:44.989712 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.989559 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 17:19:44.990462 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.990443 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 17:19:44.990557 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:44.990481 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 17:19:45.012581 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012552 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6"] Jul 08 17:19:45.012699 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012587 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zpcl8"] Jul 08 17:19:45.012699 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012609 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f75c4d5fc-84khb"] Jul 08 17:19:45.012699 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012628 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h"] Jul 08 17:19:45.012699 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012652 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t"] Jul 08 17:19:45.012699 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012694 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-zqsgm"] Jul 08 17:19:45.012927 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:19:45.012927 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:45.012927 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:19:45.012927 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.012748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:19:45.015605 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.015576 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 17:19:45.015807 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.015788 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:45.015911 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.015807 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:19:45.015911 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.015899 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rq8b\"" Jul 08 17:19:45.016012 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.015966 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:19:45.016123 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.016111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:19:45.016163 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.016128 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:45.016225 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.016210 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:19:45.016269 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.016257 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7ksx\"" Jul 08 17:19:45.016322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.016257 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z9ktl\"" Jul 08 17:19:45.028038 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.028017 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tvpn2"] Jul 08 17:19:45.028139 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.028118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.030907 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.030887 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 17:19:45.031033 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.030890 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5bxxm\"" Jul 08 17:19:45.031145 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.031067 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:45.031324 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.031296 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 17:19:45.031445 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.031427 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:45.037636 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.037611 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 17:19:45.050186 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.050167 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86758f94cf-kbj9q"] Jul 08 17:19:45.050306 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.050290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.053008 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.052972 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rc7v6\"" Jul 08 17:19:45.053103 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.053092 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 17:19:45.053164 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.053142 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 17:19:45.074492 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.074469 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd"] Jul 08 17:19:45.074607 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.074592 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.076885 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.076847 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 17:19:45.077174 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.077146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 17:19:45.077174 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.077157 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 17:19:45.077174 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.077157 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 17:19:45.077361 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.077198 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 17:19:45.077361 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.077226 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hvscl\"" Jul 08 17:19:45.077361 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.077277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 17:19:45.089028 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.089121 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-installation-pull-secrets\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.089121 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfkwt\" (UniqueName: \"kubernetes.io/projected/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-kube-api-access-wfkwt\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.089121 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-certificates\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.089121 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089104 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbrcv\" (UniqueName: \"kubernetes.io/projected/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-kube-api-access-dbrcv\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:45.089239 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49028db6-f3b9-4a15-bcb6-6a181650330d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.089239 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089216 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2951c345-cc7f-472d-a1a1-7372286fd28f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.089299 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-image-registry-private-configuration\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.089299 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-snapshots\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.089299 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28wvz\" (UniqueName: \"kubernetes.io/projected/8f8668d7-e7fe-44c6-9060-8fa4512e4e6b-kube-api-access-28wvz\") pod \"volume-data-source-validator-5d456fdbcd-2wnv6\" (UID: \"8f8668d7-e7fe-44c6-9060-8fa4512e4e6b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6" Jul 08 17:19:45.089388 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.089388 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2951c345-cc7f-472d-a1a1-7372286fd28f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.089388 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qplr\" (UniqueName: \"kubernetes.io/projected/2951c345-cc7f-472d-a1a1-7372286fd28f-kube-api-access-6qplr\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.089472 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.089472 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4t82\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-kube-api-access-g4t82\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.089472 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d42e96ab-8561-4ced-8000-c4dcd7cb5732-ca-trust-extracted\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.089472 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-trusted-ca\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.089472 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-bound-sa-token\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.089608 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-tmp\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.089608 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:45.089608 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.089608 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-serving-cert\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.089608 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.089567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdv8x\" (UniqueName: \"kubernetes.io/projected/49028db6-f3b9-4a15-bcb6-6a181650330d-kube-api-access-hdv8x\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.090391 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.090378 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mph84"] Jul 08 17:19:45.090492 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.090480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:45.092963 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.092940 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 17:19:45.092963 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.092960 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-62xxc\"" Jul 08 17:19:45.093122 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.092938 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 17:19:45.095132 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.095108 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:45.099017 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.099001 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dsdxq"] Jul 08 17:19:45.099118 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.099105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mph84" Jul 08 17:19:45.101332 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.101314 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8v2dl\"" Jul 08 17:19:45.108999 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.108981 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp"] Jul 08 17:19:45.109092 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.109082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dsdxq" Jul 08 17:19:45.111367 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.111347 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 17:19:45.111464 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.111396 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sbxhn\"" Jul 08 17:19:45.111464 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.111452 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 17:19:45.111591 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.111512 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 17:19:45.123062 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123045 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg"] Jul 08 17:19:45.123159 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123072 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dsdxq"] Jul 08 17:19:45.123159 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123085 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mph84"] Jul 08 17:19:45.123159 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123097 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd"] Jul 08 17:19:45.123159 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123109 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tvpn2"] Jul 08 17:19:45.123159 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123124 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp"] Jul 08 17:19:45.123159 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123141 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86758f94cf-kbj9q"] Jul 08 17:19:45.123159 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123152 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-zqsgm"] Jul 08 17:19:45.123534 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.123245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.125737 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.125722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 17:19:45.125884 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.125768 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 17:19:45.125884 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.125782 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:45.125884 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.125877 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 17:19:45.126063 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.125919 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lhhv9\"" Jul 08 17:19:45.158227 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.158200 2578 generic.go:356] "Generic (PLEG): container finished" podID="643d6398-c6c4-4150-84a1-ad69d828dea4" containerID="14a51178f88e35a8cdd0f28030553b80207c29196349ba830bb6080765f8eee0" exitCode=0 Jul 08 17:19:45.158351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.158229 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" event={"ID":"643d6398-c6c4-4150-84a1-ad69d828dea4","Type":"ContainerDied","Data":"14a51178f88e35a8cdd0f28030553b80207c29196349ba830bb6080765f8eee0"} Jul 08 17:19:45.190624 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.190761 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-trusted-ca\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.190761 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190664 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.190761 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2026397-8006-4d0d-839e-d050b6080d09-trusted-ca\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.190761 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.190761 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2026397-8006-4d0d-839e-d050b6080d09-serving-cert\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.191017 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8427131a-881d-406b-b7b0-babe272e3b24-config-volume\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.191017 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfkwt\" (UniqueName: \"kubernetes.io/projected/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-kube-api-access-wfkwt\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.191017 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.190835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-certificates\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.191017 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.190894 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:45.191017 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.190960 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls podName:49028db6-f3b9-4a15-bcb6-6a181650330d nodeName:}" failed. No retries permitted until 2026-07-08 17:19:45.690939255 +0000 UTC m=+36.150151767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gg5lg" (UID: "49028db6-f3b9-4a15-bcb6-6a181650330d") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:45.191248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfj4n\" (UniqueName: \"kubernetes.io/projected/f2026397-8006-4d0d-839e-d050b6080d09-kube-api-access-vfj4n\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.191248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-stats-auth\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.191248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq26p\" (UniqueName: \"kubernetes.io/projected/5b017360-f84c-4fb3-9df1-0c1b56ac9265-kube-api-access-mq26p\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.191248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z57z\" (UniqueName: \"kubernetes.io/projected/184c9592-89e4-473d-a72f-10bb604ec456-kube-api-access-4z57z\") pod \"network-check-source-989f8b8dc-mph84\" (UID: \"184c9592-89e4-473d-a72f-10bb604ec456\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mph84" Jul 08 17:19:45.191248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-default-certificate\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.191248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:45.191248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4fb7\" (UniqueName: \"kubernetes.io/projected/8427131a-881d-406b-b7b0-babe272e3b24-kube-api-access-n4fb7\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2951c345-cc7f-472d-a1a1-7372286fd28f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qplr\" (UniqueName: \"kubernetes.io/projected/2951c345-cc7f-472d-a1a1-7372286fd28f-kube-api-access-6qplr\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-certificates\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8427131a-881d-406b-b7b0-babe272e3b24-tmp-dir\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d42e96ab-8561-4ced-8000-c4dcd7cb5732-ca-trust-extracted\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-bound-sa-token\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-tmp\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191468 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25abc86d-e249-4ab8-9c88-3cbb563c8664-cert\") pod \"ingress-canary-dsdxq\" (UID: \"25abc86d-e249-4ab8-9c88-3cbb563c8664\") " pod="openshift-ingress-canary/ingress-canary-dsdxq" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-serving-cert\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.191586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdv8x\" (UniqueName: \"kubernetes.io/projected/49028db6-f3b9-4a15-bcb6-6a181650330d-kube-api-access-hdv8x\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49028db6-f3b9-4a15-bcb6-6a181650330d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-installation-pull-secrets\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.191685 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.191745 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls podName:945b5a8c-6b0c-4d8f-9e87-9ffd014621aa nodeName:}" failed. No retries permitted until 2026-07-08 17:19:45.691729966 +0000 UTC m=+36.150942476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dc66h" (UID: "945b5a8c-6b0c-4d8f-9e87-9ffd014621aa") : secret "samples-operator-tls" not found Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191752 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-trusted-ca\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrzxh\" (UniqueName: \"kubernetes.io/projected/25abc86d-e249-4ab8-9c88-3cbb563c8664-kube-api-access-vrzxh\") pod \"ingress-canary-dsdxq\" (UID: \"25abc86d-e249-4ab8-9c88-3cbb563c8664\") " pod="openshift-ingress-canary/ingress-canary-dsdxq" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbrcv\" (UniqueName: \"kubernetes.io/projected/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-kube-api-access-dbrcv\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2026397-8006-4d0d-839e-d050b6080d09-config\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.191883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d42e96ab-8561-4ced-8000-c4dcd7cb5732-ca-trust-extracted\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-tmp\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4t82\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-kube-api-access-g4t82\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.192204 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:19:45.192237 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.192221 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f75c4d5fc-84khb: secret "image-registry-tls" not found Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.192291 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls podName:d42e96ab-8561-4ced-8000-c4dcd7cb5732 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:45.692259361 +0000 UTC m=+36.151471881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls") pod "image-registry-7f75c4d5fc-84khb" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732") : secret "image-registry-tls" not found Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-image-registry-private-configuration\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-snapshots\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28wvz\" (UniqueName: \"kubernetes.io/projected/8f8668d7-e7fe-44c6-9060-8fa4512e4e6b-kube-api-access-28wvz\") pod \"volume-data-source-validator-5d456fdbcd-2wnv6\" (UID: \"8f8668d7-e7fe-44c6-9060-8fa4512e4e6b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6" Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2951c345-cc7f-472d-a1a1-7372286fd28f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/49028db6-f3b9-4a15-bcb6-6a181650330d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-snapshots\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.192956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.192928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2951c345-cc7f-472d-a1a1-7372286fd28f-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.196647 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.196511 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2951c345-cc7f-472d-a1a1-7372286fd28f-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.196748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.196679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-serving-cert\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.196748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.196743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-installation-pull-secrets\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.196879 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.196788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-image-registry-private-configuration\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.201679 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.201614 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfkwt\" (UniqueName: \"kubernetes.io/projected/402eb9e5-0f3b-43f3-98c7-19053fdc6a5e-kube-api-access-wfkwt\") pod \"insights-operator-5c847dcfc4-zpcl8\" (UID: \"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e\") " pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.201787 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.201757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qplr\" (UniqueName: \"kubernetes.io/projected/2951c345-cc7f-472d-a1a1-7372286fd28f-kube-api-access-6qplr\") pod \"kube-storage-version-migrator-operator-846bf668f7-wjm2t\" (UID: \"2951c345-cc7f-472d-a1a1-7372286fd28f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.203391 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.203112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4t82\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-kube-api-access-g4t82\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.203817 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.203794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-bound-sa-token\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.204346 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.204324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28wvz\" (UniqueName: \"kubernetes.io/projected/8f8668d7-e7fe-44c6-9060-8fa4512e4e6b-kube-api-access-28wvz\") pod \"volume-data-source-validator-5d456fdbcd-2wnv6\" (UID: \"8f8668d7-e7fe-44c6-9060-8fa4512e4e6b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6" Jul 08 17:19:45.204430 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.204390 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbrcv\" (UniqueName: \"kubernetes.io/projected/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-kube-api-access-dbrcv\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:45.204489 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.204442 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdv8x\" (UniqueName: \"kubernetes.io/projected/49028db6-f3b9-4a15-bcb6-6a181650330d-kube-api-access-hdv8x\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.245947 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.245921 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6" Jul 08 17:19:45.258182 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.258147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:45.265830 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.265809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" Jul 08 17:19:45.277634 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.277604 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" Jul 08 17:19:45.293618 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.293586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25abc86d-e249-4ab8-9c88-3cbb563c8664-cert\") pod \"ingress-canary-dsdxq\" (UID: \"25abc86d-e249-4ab8-9c88-3cbb563c8664\") " pod="openshift-ingress-canary/ingress-canary-dsdxq" Jul 08 17:19:45.293756 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.293639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3747ac00-416a-45ff-99b6-faa367ebd332-config\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.293756 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.293684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.293756 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.293711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrzxh\" (UniqueName: \"kubernetes.io/projected/25abc86d-e249-4ab8-9c88-3cbb563c8664-kube-api-access-vrzxh\") pod \"ingress-canary-dsdxq\" (UID: \"25abc86d-e249-4ab8-9c88-3cbb563c8664\") " pod="openshift-ingress-canary/ingress-canary-dsdxq" Jul 08 17:19:45.293925 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.293765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2026397-8006-4d0d-839e-d050b6080d09-config\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.293925 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.293826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.293925 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.293891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.294299 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.294141 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:19:45.294299 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.294227 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:45.294448 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.294430 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:45.794396997 +0000 UTC m=+36.253609521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : configmap references non-existent config key: service-ca.crt Jul 08 17:19:45.294629 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.294452 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:45.794442347 +0000 UTC m=+36.253654863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : secret "router-metrics-certs-default" not found Jul 08 17:19:45.294629 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.294468 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls podName:8427131a-881d-406b-b7b0-babe272e3b24 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:45.794459205 +0000 UTC m=+36.253671714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls") pod "dns-default-tvpn2" (UID: "8427131a-881d-406b-b7b0-babe272e3b24") : secret "dns-default-metrics-tls" not found Jul 08 17:19:45.294629 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2026397-8006-4d0d-839e-d050b6080d09-trusted-ca\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.294629 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294574 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2026397-8006-4d0d-839e-d050b6080d09-config\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.294629 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2026397-8006-4d0d-839e-d050b6080d09-serving-cert\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8427131a-881d-406b-b7b0-babe272e3b24-config-volume\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfj4n\" (UniqueName: \"kubernetes.io/projected/f2026397-8006-4d0d-839e-d050b6080d09-kube-api-access-vfj4n\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-stats-auth\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq26p\" (UniqueName: \"kubernetes.io/projected/5b017360-f84c-4fb3-9df1-0c1b56ac9265-kube-api-access-mq26p\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z57z\" (UniqueName: \"kubernetes.io/projected/184c9592-89e4-473d-a72f-10bb604ec456-kube-api-access-4z57z\") pod \"network-check-source-989f8b8dc-mph84\" (UID: \"184c9592-89e4-473d-a72f-10bb604ec456\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mph84" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-default-certificate\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:45.294936 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9pgt\" (UniqueName: \"kubernetes.io/projected/3747ac00-416a-45ff-99b6-faa367ebd332-kube-api-access-j9pgt\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.295374 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.294987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4fb7\" (UniqueName: \"kubernetes.io/projected/8427131a-881d-406b-b7b0-babe272e3b24-kube-api-access-n4fb7\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.295374 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.295017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3747ac00-416a-45ff-99b6-faa367ebd332-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.295374 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.295052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8427131a-881d-406b-b7b0-babe272e3b24-tmp-dir\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.295374 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.295360 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8427131a-881d-406b-b7b0-babe272e3b24-tmp-dir\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.295579 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.295443 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:19:45.295579 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.295538 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert podName:55cd57c0-ee6d-4cbd-b5ed-c407d478d01e nodeName:}" failed. No retries permitted until 2026-07-08 17:19:45.795482314 +0000 UTC m=+36.254694831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-q9vmd" (UID: "55cd57c0-ee6d-4cbd-b5ed-c407d478d01e") : secret "networking-console-plugin-cert" not found Jul 08 17:19:45.296497 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.296002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:45.296497 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.296235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8427131a-881d-406b-b7b0-babe272e3b24-config-volume\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.297237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.297182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25abc86d-e249-4ab8-9c88-3cbb563c8664-cert\") pod \"ingress-canary-dsdxq\" (UID: \"25abc86d-e249-4ab8-9c88-3cbb563c8664\") " pod="openshift-ingress-canary/ingress-canary-dsdxq" Jul 08 17:19:45.297647 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.297624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2026397-8006-4d0d-839e-d050b6080d09-serving-cert\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.298458 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.298438 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-default-certificate\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.299299 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.299276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-stats-auth\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.302912 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.302634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrzxh\" (UniqueName: \"kubernetes.io/projected/25abc86d-e249-4ab8-9c88-3cbb563c8664-kube-api-access-vrzxh\") pod \"ingress-canary-dsdxq\" (UID: \"25abc86d-e249-4ab8-9c88-3cbb563c8664\") " pod="openshift-ingress-canary/ingress-canary-dsdxq" Jul 08 17:19:45.303917 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.303896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq26p\" (UniqueName: \"kubernetes.io/projected/5b017360-f84c-4fb3-9df1-0c1b56ac9265-kube-api-access-mq26p\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.304404 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.304386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfj4n\" (UniqueName: \"kubernetes.io/projected/f2026397-8006-4d0d-839e-d050b6080d09-kube-api-access-vfj4n\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.304575 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.304556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4fb7\" (UniqueName: \"kubernetes.io/projected/8427131a-881d-406b-b7b0-babe272e3b24-kube-api-access-n4fb7\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.304895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.304872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2026397-8006-4d0d-839e-d050b6080d09-trusted-ca\") pod \"console-operator-68b757fb67-zqsgm\" (UID: \"f2026397-8006-4d0d-839e-d050b6080d09\") " pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.305393 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.305375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z57z\" (UniqueName: \"kubernetes.io/projected/184c9592-89e4-473d-a72f-10bb604ec456-kube-api-access-4z57z\") pod \"network-check-source-989f8b8dc-mph84\" (UID: \"184c9592-89e4-473d-a72f-10bb604ec456\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mph84" Jul 08 17:19:45.347137 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.346610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:19:45.397875 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.396675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3747ac00-416a-45ff-99b6-faa367ebd332-config\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.397875 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.396917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgt\" (UniqueName: \"kubernetes.io/projected/3747ac00-416a-45ff-99b6-faa367ebd332-kube-api-access-j9pgt\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.397875 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.396978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3747ac00-416a-45ff-99b6-faa367ebd332-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.397875 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.397806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3747ac00-416a-45ff-99b6-faa367ebd332-config\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.400257 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.400205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3747ac00-416a-45ff-99b6-faa367ebd332-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.407677 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.407478 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mph84" Jul 08 17:19:45.410413 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.410335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9pgt\" (UniqueName: \"kubernetes.io/projected/3747ac00-416a-45ff-99b6-faa367ebd332-kube-api-access-j9pgt\") pod \"service-ca-operator-5d46d9ffd4-bb8wp\" (UID: \"3747ac00-416a-45ff-99b6-faa367ebd332\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.418552 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.416965 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dsdxq" Jul 08 17:19:45.430932 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.430759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" Jul 08 17:19:45.472593 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.472562 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6"] Jul 08 17:19:45.475580 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.475503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-zpcl8"] Jul 08 17:19:45.476671 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:45.476644 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8668d7_e7fe_44c6_9060_8fa4512e4e6b.slice/crio-3b2d7a2d8a67f8024222e55ad2803ff002b92f46fa56a837355627d4b8a8a353 WatchSource:0}: Error finding container 3b2d7a2d8a67f8024222e55ad2803ff002b92f46fa56a837355627d4b8a8a353: Status 404 returned error can't find the container with id 3b2d7a2d8a67f8024222e55ad2803ff002b92f46fa56a837355627d4b8a8a353 Jul 08 17:19:45.479237 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:45.479173 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402eb9e5_0f3b_43f3_98c7_19053fdc6a5e.slice/crio-e80686cbd401f356efd4174ab703509c5e90934dfc001c0b86b47a867c58467a WatchSource:0}: Error finding container e80686cbd401f356efd4174ab703509c5e90934dfc001c0b86b47a867c58467a: Status 404 returned error can't find the container with id e80686cbd401f356efd4174ab703509c5e90934dfc001c0b86b47a867c58467a Jul 08 17:19:45.481532 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.481390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t"] Jul 08 17:19:45.487479 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:45.487451 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2951c345_cc7f_472d_a1a1_7372286fd28f.slice/crio-1828dc63590b8f9e427ee1a1b523da326e618827dd748836d7b21af762d0890e WatchSource:0}: Error finding container 1828dc63590b8f9e427ee1a1b523da326e618827dd748836d7b21af762d0890e: Status 404 returned error can't find the container with id 1828dc63590b8f9e427ee1a1b523da326e618827dd748836d7b21af762d0890e Jul 08 17:19:45.552630 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.552577 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-zqsgm"] Jul 08 17:19:45.556113 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:45.556065 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2026397_8006_4d0d_839e_d050b6080d09.slice/crio-0d591821e7cc4f0a9f8a0429ade899c0c7244184e0a96c36c8328f3d81309f5d WatchSource:0}: Error finding container 0d591821e7cc4f0a9f8a0429ade899c0c7244184e0a96c36c8328f3d81309f5d: Status 404 returned error can't find the container with id 0d591821e7cc4f0a9f8a0429ade899c0c7244184e0a96c36c8328f3d81309f5d Jul 08 17:19:45.592721 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.592688 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mph84"] Jul 08 17:19:45.595818 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:45.595788 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184c9592_89e4_473d_a72f_10bb604ec456.slice/crio-c323330d1294cf1c74d694921a872246f99fdb3c582e28d475238bb25639b47b WatchSource:0}: Error finding container c323330d1294cf1c74d694921a872246f99fdb3c582e28d475238bb25639b47b: Status 404 returned error can't find the container with id c323330d1294cf1c74d694921a872246f99fdb3c582e28d475238bb25639b47b Jul 08 17:19:45.598774 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.598754 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dsdxq"] Jul 08 17:19:45.601380 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:45.601358 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25abc86d_e249_4ab8_9c88_3cbb563c8664.slice/crio-743868d875b9a353042617eeecd300e8053fa6663405cc877fd330f913fbd482 WatchSource:0}: Error finding container 743868d875b9a353042617eeecd300e8053fa6663405cc877fd330f913fbd482: Status 404 returned error can't find the container with id 743868d875b9a353042617eeecd300e8053fa6663405cc877fd330f913fbd482 Jul 08 17:19:45.611716 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.611694 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp"] Jul 08 17:19:45.613687 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:45.613664 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3747ac00_416a_45ff_99b6_faa367ebd332.slice/crio-5796a3b4f1d2498748a14d27ac58274b0a4b4dca4fafc4505c37badfa76ec2c6 WatchSource:0}: Error finding container 5796a3b4f1d2498748a14d27ac58274b0a4b4dca4fafc4505c37badfa76ec2c6: Status 404 returned error can't find the container with id 5796a3b4f1d2498748a14d27ac58274b0a4b4dca4fafc4505c37badfa76ec2c6 Jul 08 17:19:45.698848 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.698820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:45.699035 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.698941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:45.699035 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.698975 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:19:45.699035 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.699025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:45.699197 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.699043 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls podName:945b5a8c-6b0c-4d8f-9e87-9ffd014621aa nodeName:}" failed. No retries permitted until 2026-07-08 17:19:46.69902474 +0000 UTC m=+37.158237267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dc66h" (UID: "945b5a8c-6b0c-4d8f-9e87-9ffd014621aa") : secret "samples-operator-tls" not found Jul 08 17:19:45.699197 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.699094 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:45.699197 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.699096 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:19:45.699197 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.699118 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f75c4d5fc-84khb: secret "image-registry-tls" not found Jul 08 17:19:45.699197 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.699135 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls podName:49028db6-f3b9-4a15-bcb6-6a181650330d nodeName:}" failed. No retries permitted until 2026-07-08 17:19:46.699122351 +0000 UTC m=+37.158334883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gg5lg" (UID: "49028db6-f3b9-4a15-bcb6-6a181650330d") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:45.699197 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.699170 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls podName:d42e96ab-8561-4ced-8000-c4dcd7cb5732 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:46.699152741 +0000 UTC m=+37.158365264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls") pod "image-registry-7f75c4d5fc-84khb" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732") : secret "image-registry-tls" not found Jul 08 17:19:45.800238 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.800204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:45.800403 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.800295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.800403 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.800343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:45.800403 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.800359 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:19:45.800403 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.800373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:45.800548 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.800424 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert podName:55cd57c0-ee6d-4cbd-b5ed-c407d478d01e nodeName:}" failed. No retries permitted until 2026-07-08 17:19:46.800405262 +0000 UTC m=+37.259617786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-q9vmd" (UID: "55cd57c0-ee6d-4cbd-b5ed-c407d478d01e") : secret "networking-console-plugin-cert" not found Jul 08 17:19:45.800548 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.800449 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:19:45.800548 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.800460 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:45.800548 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.800475 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:46.80045739 +0000 UTC m=+37.259669914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : configmap references non-existent config key: service-ca.crt Jul 08 17:19:45.800548 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.800498 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:46.800487867 +0000 UTC m=+37.259700377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : secret "router-metrics-certs-default" not found Jul 08 17:19:45.800548 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:45.800514 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls podName:8427131a-881d-406b-b7b0-babe272e3b24 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:46.800507388 +0000 UTC m=+37.259719898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls") pod "dns-default-tvpn2" (UID: "8427131a-881d-406b-b7b0-babe272e3b24") : secret "dns-default-metrics-tls" not found Jul 08 17:19:45.845416 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.845372 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:45.945483 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:45.945447 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:46.161914 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.161639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mph84" event={"ID":"184c9592-89e4-473d-a72f-10bb604ec456","Type":"ContainerStarted","Data":"c323330d1294cf1c74d694921a872246f99fdb3c582e28d475238bb25639b47b"} Jul 08 17:19:46.162882 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.162843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" event={"ID":"f2026397-8006-4d0d-839e-d050b6080d09","Type":"ContainerStarted","Data":"0d591821e7cc4f0a9f8a0429ade899c0c7244184e0a96c36c8328f3d81309f5d"} Jul 08 17:19:46.163901 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.163878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" event={"ID":"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e","Type":"ContainerStarted","Data":"e80686cbd401f356efd4174ab703509c5e90934dfc001c0b86b47a867c58467a"} Jul 08 17:19:46.164907 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.164891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6" event={"ID":"8f8668d7-e7fe-44c6-9060-8fa4512e4e6b","Type":"ContainerStarted","Data":"3b2d7a2d8a67f8024222e55ad2803ff002b92f46fa56a837355627d4b8a8a353"} Jul 08 17:19:46.168436 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.166835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" event={"ID":"2951c345-cc7f-472d-a1a1-7372286fd28f","Type":"ContainerStarted","Data":"1828dc63590b8f9e427ee1a1b523da326e618827dd748836d7b21af762d0890e"} Jul 08 17:19:46.170501 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.170479 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" event={"ID":"3747ac00-416a-45ff-99b6-faa367ebd332","Type":"ContainerStarted","Data":"5796a3b4f1d2498748a14d27ac58274b0a4b4dca4fafc4505c37badfa76ec2c6"} Jul 08 17:19:46.171515 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.171488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dsdxq" event={"ID":"25abc86d-e249-4ab8-9c88-3cbb563c8664","Type":"ContainerStarted","Data":"743868d875b9a353042617eeecd300e8053fa6663405cc877fd330f913fbd482"} Jul 08 17:19:46.707949 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.707911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:46.708111 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.708005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:46.708111 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.708089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:46.708882 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.708218 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:46.708882 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.708283 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls podName:49028db6-f3b9-4a15-bcb6-6a181650330d nodeName:}" failed. No retries permitted until 2026-07-08 17:19:48.708264903 +0000 UTC m=+39.167477428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gg5lg" (UID: "49028db6-f3b9-4a15-bcb6-6a181650330d") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:46.708882 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.708680 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:19:46.708882 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.708732 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls podName:945b5a8c-6b0c-4d8f-9e87-9ffd014621aa nodeName:}" failed. No retries permitted until 2026-07-08 17:19:48.708715916 +0000 UTC m=+39.167928444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dc66h" (UID: "945b5a8c-6b0c-4d8f-9e87-9ffd014621aa") : secret "samples-operator-tls" not found Jul 08 17:19:46.708882 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.708793 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:19:46.708882 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.708805 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f75c4d5fc-84khb: secret "image-registry-tls" not found Jul 08 17:19:46.708882 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.708837 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls podName:d42e96ab-8561-4ced-8000-c4dcd7cb5732 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:48.708825702 +0000 UTC m=+39.168038226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls") pod "image-registry-7f75c4d5fc-84khb" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732") : secret "image-registry-tls" not found Jul 08 17:19:46.807081 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.806923 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.808580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.808648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.808680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.808764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.808933 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.808991 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert podName:55cd57c0-ee6d-4cbd-b5ed-c407d478d01e nodeName:}" failed. No retries permitted until 2026-07-08 17:19:48.808973829 +0000 UTC m=+39.268186344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-q9vmd" (UID: "55cd57c0-ee6d-4cbd-b5ed-c407d478d01e") : secret "networking-console-plugin-cert" not found Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.809052 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.809083 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:48.809071883 +0000 UTC m=+39.268284410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : secret "router-metrics-certs-default" not found Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.809144 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:48.809134041 +0000 UTC m=+39.268346551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : configmap references non-existent config key: service-ca.crt Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.809200 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:46.809416 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:46.809315 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls podName:8427131a-881d-406b-b7b0-babe272e3b24 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:48.809274711 +0000 UTC m=+39.268487223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls") pod "dns-default-tvpn2" (UID: "8427131a-881d-406b-b7b0-babe272e3b24") : secret "dns-default-metrics-tls" not found Jul 08 17:19:46.914948 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:46.914845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:47.184482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:47.183542 2578 generic.go:356] "Generic (PLEG): container finished" podID="643d6398-c6c4-4150-84a1-ad69d828dea4" containerID="a81e532aa9eae871ea7af078fb8a78c8429f7f69615104f833e71549a8d0fe1a" exitCode=0 Jul 08 17:19:47.184482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:47.183614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" event={"ID":"643d6398-c6c4-4150-84a1-ad69d828dea4","Type":"ContainerDied","Data":"a81e532aa9eae871ea7af078fb8a78c8429f7f69615104f833e71549a8d0fe1a"} Jul 08 17:19:47.748309 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:47.748258 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:48.731552 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:48.731449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:48.731574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:48.731649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.731658 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.731741 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls podName:49028db6-f3b9-4a15-bcb6-6a181650330d nodeName:}" failed. No retries permitted until 2026-07-08 17:19:52.731719067 +0000 UTC m=+43.190931587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gg5lg" (UID: "49028db6-f3b9-4a15-bcb6-6a181650330d") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.731750 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.731756 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.731823 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f75c4d5fc-84khb: secret "image-registry-tls" not found Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.731807 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls podName:945b5a8c-6b0c-4d8f-9e87-9ffd014621aa nodeName:}" failed. No retries permitted until 2026-07-08 17:19:52.731794223 +0000 UTC m=+43.191006733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dc66h" (UID: "945b5a8c-6b0c-4d8f-9e87-9ffd014621aa") : secret "samples-operator-tls" not found Jul 08 17:19:48.732015 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.731904 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls podName:d42e96ab-8561-4ced-8000-c4dcd7cb5732 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:52.731885729 +0000 UTC m=+43.191098239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls") pod "image-registry-7f75c4d5fc-84khb" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732") : secret "image-registry-tls" not found Jul 08 17:19:48.832884 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:48.832805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:48.833088 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.833056 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:19:48.833205 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.833136 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert podName:55cd57c0-ee6d-4cbd-b5ed-c407d478d01e nodeName:}" failed. No retries permitted until 2026-07-08 17:19:52.833116313 +0000 UTC m=+43.292328838 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-q9vmd" (UID: "55cd57c0-ee6d-4cbd-b5ed-c407d478d01e") : secret "networking-console-plugin-cert" not found Jul 08 17:19:48.833205 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:48.833182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:48.833292 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:48.833242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:48.833292 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:48.833275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:48.833429 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.833412 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:48.833496 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.833450 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls podName:8427131a-881d-406b-b7b0-babe272e3b24 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:52.833438511 +0000 UTC m=+43.292651024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls") pod "dns-default-tvpn2" (UID: "8427131a-881d-406b-b7b0-babe272e3b24") : secret "dns-default-metrics-tls" not found Jul 08 17:19:48.833553 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.833506 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:19:48.833553 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.833536 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:52.833526733 +0000 UTC m=+43.292739254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : secret "router-metrics-certs-default" not found Jul 08 17:19:48.833657 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:48.833588 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:52.833571079 +0000 UTC m=+43.292783590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : configmap references non-existent config key: service-ca.crt Jul 08 17:19:49.703140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:49.703100 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:49.777818 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:49.777780 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:50.984382 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:50.984336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:51.063557 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:51.063524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:51.122205 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:51.122162 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:52.028915 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.028877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:52.112081 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.111989 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:52.772339 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.772301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:19:52.772513 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.772406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:19:52.772513 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.772478 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:19:52.772513 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.772500 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f75c4d5fc-84khb: secret "image-registry-tls" not found Jul 08 17:19:52.772604 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.772512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:19:52.772604 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.772559 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls podName:d42e96ab-8561-4ced-8000-c4dcd7cb5732 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.772540403 +0000 UTC m=+51.231752913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls") pod "image-registry-7f75c4d5fc-84khb" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732") : secret "image-registry-tls" not found Jul 08 17:19:52.772686 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.772629 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:19:52.772686 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.772681 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls podName:945b5a8c-6b0c-4d8f-9e87-9ffd014621aa nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.772664767 +0000 UTC m=+51.231877303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dc66h" (UID: "945b5a8c-6b0c-4d8f-9e87-9ffd014621aa") : secret "samples-operator-tls" not found Jul 08 17:19:52.772759 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.772733 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:52.772759 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.772758 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls podName:49028db6-f3b9-4a15-bcb6-6a181650330d nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.772749789 +0000 UTC m=+51.231962299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gg5lg" (UID: "49028db6-f3b9-4a15-bcb6-6a181650330d") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.873396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.873471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.873506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.873564 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:52.873627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.873635 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.873615092 +0000 UTC m=+51.332827606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : secret "router-metrics-certs-default" not found Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.873673 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.87365576 +0000 UTC m=+51.332868274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : configmap references non-existent config key: service-ca.crt Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.873694 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.873730 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls podName:8427131a-881d-406b-b7b0-babe272e3b24 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.873719047 +0000 UTC m=+51.332931557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls") pod "dns-default-tvpn2" (UID: "8427131a-881d-406b-b7b0-babe272e3b24") : secret "dns-default-metrics-tls" not found Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.873728 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:19:52.873985 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:52.873767 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert podName:55cd57c0-ee6d-4cbd-b5ed-c407d478d01e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.873756699 +0000 UTC m=+51.332969208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-q9vmd" (UID: "55cd57c0-ee6d-4cbd-b5ed-c407d478d01e") : secret "networking-console-plugin-cert" not found Jul 08 17:19:56.055200 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.055111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:56.209694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.209660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mph84" event={"ID":"184c9592-89e4-473d-a72f-10bb604ec456","Type":"ContainerStarted","Data":"5a34db3435744753aba849291d3f0e9fad8a07fd4ed1306e357052ab330c820c"} Jul 08 17:19:56.211647 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.211623 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/0.log" Jul 08 17:19:56.211766 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.211660 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2026397-8006-4d0d-839e-d050b6080d09" containerID="42baf2f0923592be3204ecf28c3b541568697306a568feb158481fa6df88d6f4" exitCode=255 Jul 08 17:19:56.211766 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.211697 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" event={"ID":"f2026397-8006-4d0d-839e-d050b6080d09","Type":"ContainerDied","Data":"42baf2f0923592be3204ecf28c3b541568697306a568feb158481fa6df88d6f4"} Jul 08 17:19:56.211948 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.211931 2578 scope.go:117] "RemoveContainer" containerID="42baf2f0923592be3204ecf28c3b541568697306a568feb158481fa6df88d6f4" Jul 08 17:19:56.213364 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.213335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" event={"ID":"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e","Type":"ContainerStarted","Data":"e8a69e14eda0574ba1f5095463a4fe9a35a4b487f6db31eadc3d25b1d74e65f0"} Jul 08 17:19:56.215209 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.215163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6" event={"ID":"8f8668d7-e7fe-44c6-9060-8fa4512e4e6b","Type":"ContainerStarted","Data":"9772a4a23d43b6bff1b3a9b12f86ab64b36eadefabd8ec5db3ed74a6c861bcd0"} Jul 08 17:19:56.218409 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.218320 2578 generic.go:356] "Generic (PLEG): container finished" podID="643d6398-c6c4-4150-84a1-ad69d828dea4" containerID="5ac1eb1310e7e9ceb423d20c05ba018e58247b672dbeaf0b603a7acca89986af" exitCode=0 Jul 08 17:19:56.218512 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.218404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" event={"ID":"643d6398-c6c4-4150-84a1-ad69d828dea4","Type":"ContainerDied","Data":"5ac1eb1310e7e9ceb423d20c05ba018e58247b672dbeaf0b603a7acca89986af"} Jul 08 17:19:56.220080 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.220059 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" event={"ID":"2951c345-cc7f-472d-a1a1-7372286fd28f","Type":"ContainerStarted","Data":"028b6700c64790232e984b716cfc8a03c9a02b839f8cb92a18bfeb121fb7d6df"} Jul 08 17:19:56.221599 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.221578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" event={"ID":"3747ac00-416a-45ff-99b6-faa367ebd332","Type":"ContainerStarted","Data":"1f104616aa7cc91f07912c963c4faf9dfbda5fb9bc36bb8d0322ff8974fdda3b"} Jul 08 17:19:56.223116 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.223088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dsdxq" event={"ID":"25abc86d-e249-4ab8-9c88-3cbb563c8664","Type":"ContainerStarted","Data":"0d579bea5b1784333f1a0da4f7745c60354ef94a901207e37355620ad43bc9ba"} Jul 08 17:19:56.225906 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.225844 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mph84" podStartSLOduration=25.585834655 podStartE2EDuration="35.225829136s" totalImagesPullingTime="9.639994481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:56.225264472 +0000 UTC m=+46.684477008" watchObservedRunningTime="2026-07-08 17:19:56.225829136 +0000 UTC m=+46.685041668" Jul 08 17:19:56.244100 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.244056 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" podStartSLOduration=25.508802776 podStartE2EDuration="35.244034237s" totalImagesPullingTime="9.735231461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:56.243942008 +0000 UTC m=+46.703154539" watchObservedRunningTime="2026-07-08 17:19:56.244034237 +0000 UTC m=+46.703246772" Jul 08 17:19:56.283751 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.283700 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dsdxq" podStartSLOduration=2.660495652 podStartE2EDuration="12.283679863s" totalImagesPullingTime="9.623184211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:56.261640196 +0000 UTC m=+46.720852729" watchObservedRunningTime="2026-07-08 17:19:56.283679863 +0000 UTC m=+46.742892396" Jul 08 17:19:56.284388 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.284348 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" podStartSLOduration=24.6722044 podStartE2EDuration="34.284307223s" totalImagesPullingTime="9.612102823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:56.283399355 +0000 UTC m=+46.742611888" watchObservedRunningTime="2026-07-08 17:19:56.284307223 +0000 UTC m=+46.743519759" Jul 08 17:19:56.345792 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.345741 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" podStartSLOduration=25.65484747 podStartE2EDuration="35.345720161s" totalImagesPullingTime="9.690872691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:56.304492465 +0000 UTC m=+46.763704996" watchObservedRunningTime="2026-07-08 17:19:56.345720161 +0000 UTC m=+46.804932695" Jul 08 17:19:56.364562 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.364518 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2wnv6" podStartSLOduration=27.251938365 podStartE2EDuration="35.364500228s" totalImagesPullingTime="8.112561863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:56.3637778 +0000 UTC m=+46.822990332" watchObservedRunningTime="2026-07-08 17:19:56.364500228 +0000 UTC m=+46.823712760" Jul 08 17:19:56.506120 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.506088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:56.597127 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.596905 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2ss7k"] Jul 08 17:19:56.614171 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.614134 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:56.617712 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.617687 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2ss7k"] Jul 08 17:19:56.617844 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.617804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.620603 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.620579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 17:19:56.620799 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.620582 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 17:19:56.620909 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.620585 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bqdcg\"" Jul 08 17:19:56.702914 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.702880 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:56.709990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.709963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-crio-socket\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.710107 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.710009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.710107 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.710100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-data-volume\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.710219 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.710128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.710219 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.710177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49mtw\" (UniqueName: \"kubernetes.io/projected/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-api-access-49mtw\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.811030 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.810996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-data-volume\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.811030 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.811030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.811270 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.811063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49mtw\" (UniqueName: \"kubernetes.io/projected/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-api-access-49mtw\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.811270 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:56.811216 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:19:56.811387 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:56.811274 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:57.311257295 +0000 UTC m=+47.770469804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : secret "insights-runtime-extractor-tls" not found Jul 08 17:19:56.811387 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.811325 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-data-volume\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.811509 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.811389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-crio-socket\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.811509 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.811414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.811509 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:56.811476 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:19:56.811509 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:56.811509 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:57.311498749 +0000 UTC m=+47.770711263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : configmap "kube-rbac-proxy" not found Jul 08 17:19:56.811708 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.811556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-crio-socket\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.822898 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.822875 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49mtw\" (UniqueName: \"kubernetes.io/projected/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-api-access-49mtw\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:56.904954 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.904916 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:56.970987 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:56.970950 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:57.112027 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.111983 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:57.209972 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.209873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:57.228202 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.228181 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:19:57.228608 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.228594 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/0.log" Jul 08 17:19:57.228685 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.228625 2578 generic.go:356] "Generic (PLEG): container finished" podID="f2026397-8006-4d0d-839e-d050b6080d09" containerID="a4f0090fc6282141548dce593da0e1824d42fa506e859c467e8433107b775dd1" exitCode=255 Jul 08 17:19:57.228685 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.228666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" event={"ID":"f2026397-8006-4d0d-839e-d050b6080d09","Type":"ContainerDied","Data":"a4f0090fc6282141548dce593da0e1824d42fa506e859c467e8433107b775dd1"} Jul 08 17:19:57.228784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.228731 2578 scope.go:117] "RemoveContainer" containerID="42baf2f0923592be3204ecf28c3b541568697306a568feb158481fa6df88d6f4" Jul 08 17:19:57.228991 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.228972 2578 scope.go:117] "RemoveContainer" containerID="a4f0090fc6282141548dce593da0e1824d42fa506e859c467e8433107b775dd1" Jul 08 17:19:57.229194 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:57.229168 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-zqsgm_openshift-console-operator(f2026397-8006-4d0d-839e-d050b6080d09)\"" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" podUID="f2026397-8006-4d0d-839e-d050b6080d09" Jul 08 17:19:57.231821 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.231796 2578 generic.go:356] "Generic (PLEG): container finished" podID="643d6398-c6c4-4150-84a1-ad69d828dea4" containerID="eeb791da3951c7ee1d5f30fef33641585e0e062a188e882bb0d6b3a5a9ea9832" exitCode=0 Jul 08 17:19:57.231961 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.231930 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" event={"ID":"643d6398-c6c4-4150-84a1-ad69d828dea4","Type":"ContainerDied","Data":"eeb791da3951c7ee1d5f30fef33641585e0e062a188e882bb0d6b3a5a9ea9832"} Jul 08 17:19:57.315358 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.315327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:57.315527 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:57.315432 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:19:57.315527 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:57.315500 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:58.315480672 +0000 UTC m=+48.774693184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : configmap "kube-rbac-proxy" not found Jul 08 17:19:57.315983 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.315957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:57.316108 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:57.316092 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:19:57.316160 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:57.316144 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:19:58.316129692 +0000 UTC m=+48.775342217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : secret "insights-runtime-extractor-tls" not found Jul 08 17:19:57.517544 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.517468 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq"] Jul 08 17:19:57.534467 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.534433 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" Jul 08 17:19:57.537948 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.537923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2586s\"" Jul 08 17:19:57.538090 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.537923 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 17:19:57.538090 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.537923 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 17:19:57.539296 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.539134 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq"] Jul 08 17:19:57.581619 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.581584 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:57.600709 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.600688 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8l29s_c99ae904-7b63-4095-8f36-fc81fad48a13/dns-node-resolver/0.log" Jul 08 17:19:57.619334 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.619306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttfm9\" (UniqueName: \"kubernetes.io/projected/011d86f9-e7f5-4ac5-b36d-533952bd3bb3-kube-api-access-ttfm9\") pod \"migrator-d57d58cc9-4zfwq\" (UID: \"011d86f9-e7f5-4ac5-b36d-533952bd3bb3\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" Jul 08 17:19:57.667198 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.667157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:57.719808 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.719773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttfm9\" (UniqueName: \"kubernetes.io/projected/011d86f9-e7f5-4ac5-b36d-533952bd3bb3-kube-api-access-ttfm9\") pod \"migrator-d57d58cc9-4zfwq\" (UID: \"011d86f9-e7f5-4ac5-b36d-533952bd3bb3\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" Jul 08 17:19:57.728988 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.728958 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttfm9\" (UniqueName: \"kubernetes.io/projected/011d86f9-e7f5-4ac5-b36d-533952bd3bb3-kube-api-access-ttfm9\") pod \"migrator-d57d58cc9-4zfwq\" (UID: \"011d86f9-e7f5-4ac5-b36d-533952bd3bb3\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" Jul 08 17:19:57.847371 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.847290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" Jul 08 17:19:57.999481 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:57.999305 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq"] Jul 08 17:19:58.001971 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:19:58.001946 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011d86f9_e7f5_4ac5_b36d_533952bd3bb3.slice/crio-96855f97223c741ec298be9104870aea5de981eaf7d1e2cbaf3418325b80182c WatchSource:0}: Error finding container 96855f97223c741ec298be9104870aea5de981eaf7d1e2cbaf3418325b80182c: Status 404 returned error can't find the container with id 96855f97223c741ec298be9104870aea5de981eaf7d1e2cbaf3418325b80182c Jul 08 17:19:58.107593 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.107494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:58.163545 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.163506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:58.239403 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.239371 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" event={"ID":"643d6398-c6c4-4150-84a1-ad69d828dea4","Type":"ContainerStarted","Data":"13a5367e1e51625c22e78aa92e6f5e1a94a0690050e9b6178a9cbe6938b4c3d6"} Jul 08 17:19:58.240593 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.240570 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" event={"ID":"011d86f9-e7f5-4ac5-b36d-533952bd3bb3","Type":"ContainerStarted","Data":"96855f97223c741ec298be9104870aea5de981eaf7d1e2cbaf3418325b80182c"} Jul 08 17:19:58.242086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.242064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:19:58.242352 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.242338 2578 scope.go:117] "RemoveContainer" containerID="a4f0090fc6282141548dce593da0e1824d42fa506e859c467e8433107b775dd1" Jul 08 17:19:58.242496 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:58.242473 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-zqsgm_openshift-console-operator(f2026397-8006-4d0d-839e-d050b6080d09)\"" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" podUID="f2026397-8006-4d0d-839e-d050b6080d09" Jul 08 17:19:58.263044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.262994 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mjv4j" podStartSLOduration=8.491046189 podStartE2EDuration="48.262978697s" totalImagesPullingTime="39.771932508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:19:58.260714286 +0000 UTC m=+48.719926858" watchObservedRunningTime="2026-07-08 17:19:58.262978697 +0000 UTC m=+48.722191229" Jul 08 17:19:58.325833 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.325795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:58.326014 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:58.325899 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:19:58.326014 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:58.325961 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.32594218 +0000 UTC m=+50.785154696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : configmap "kube-rbac-proxy" not found Jul 08 17:19:58.326119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.326101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:19:58.326239 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:58.326217 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:19:58.326370 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:19:58.326264 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:00.326251323 +0000 UTC m=+50.785463871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : secret "insights-runtime-extractor-tls" not found Jul 08 17:19:58.360636 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.360554 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:58.421693 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.421661 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:58.997815 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:58.997790 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vzffn_6a846c6d-9a94-452e-8097-b893b996e20e/node-ca/0.log" Jul 08 17:19:59.224870 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:59.224817 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:59.291135 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:59.291056 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:19:59.397465 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:19:59.397396 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dsdxq_25abc86d-e249-4ab8-9c88-3cbb563c8664/serve-healthcheck-canary/0.log" Jul 08 17:20:00.250163 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.250078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" event={"ID":"011d86f9-e7f5-4ac5-b36d-533952bd3bb3","Type":"ContainerStarted","Data":"9e2634ae9a04531f5d67788d18a88cf81deddd8bf1cb4d5ddb46f933f4adca35"} Jul 08 17:20:00.250163 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.250130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" event={"ID":"011d86f9-e7f5-4ac5-b36d-533952bd3bb3","Type":"ContainerStarted","Data":"ffa9d828b98507e3a0ad727d82650d0cb8127f2776dae3f99844c6ecee86b03a"} Jul 08 17:20:00.277367 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.277318 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4zfwq" podStartSLOduration=1.3436376540000001 podStartE2EDuration="3.277302315s" totalImagesPullingTime="1.933664661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:00.274337956 +0000 UTC m=+50.733550489" watchObservedRunningTime="2026-07-08 17:20:00.277302315 +0000 UTC m=+50.736514848" Jul 08 17:20:00.298616 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.298579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:00.343746 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.343717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:20:00.343883 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.343781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:20:00.343883 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.343837 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:20:00.344009 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.343908 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:04.343893385 +0000 UTC m=+54.803105894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : configmap "kube-rbac-proxy" not found Jul 08 17:20:00.344009 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.343955 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:00.344089 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.344017 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:04.343999715 +0000 UTC m=+54.803212240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:00.779774 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.779739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:00.849318 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.849286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:20:00.849482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.849379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:20:00.849482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.849424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:20:00.849482 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.849443 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:20:00.849594 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.849511 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:20:00.849594 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.849522 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:20:00.849594 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.849533 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f75c4d5fc-84khb: secret "image-registry-tls" not found Jul 08 17:20:00.849594 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.849570 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls podName:49028db6-f3b9-4a15-bcb6-6a181650330d nodeName:}" failed. No retries permitted until 2026-07-08 17:20:16.849550135 +0000 UTC m=+67.308762646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-gg5lg" (UID: "49028db6-f3b9-4a15-bcb6-6a181650330d") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:20:00.849594 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.849591 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls podName:d42e96ab-8561-4ced-8000-c4dcd7cb5732 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:16.849581452 +0000 UTC m=+67.308793963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls") pod "image-registry-7f75c4d5fc-84khb" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732") : secret "image-registry-tls" not found Jul 08 17:20:00.849774 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.849607 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls podName:945b5a8c-6b0c-4d8f-9e87-9ffd014621aa nodeName:}" failed. No retries permitted until 2026-07-08 17:20:16.849600305 +0000 UTC m=+67.308812821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dc66h" (UID: "945b5a8c-6b0c-4d8f-9e87-9ffd014621aa") : secret "samples-operator-tls" not found Jul 08 17:20:00.950489 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.950452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:20:00.950699 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.950572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:00.950699 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.950614 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:20:00.950699 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.950624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:00.950699 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:00.950662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:20:00.950699 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.950675 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:20:00.950983 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.950684 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert podName:55cd57c0-ee6d-4cbd-b5ed-c407d478d01e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:16.950665134 +0000 UTC m=+67.409877646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-q9vmd" (UID: "55cd57c0-ee6d-4cbd-b5ed-c407d478d01e") : secret "networking-console-plugin-cert" not found Jul 08 17:20:00.950983 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.950736 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:20:00.950983 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.950767 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:16.950746341 +0000 UTC m=+67.409958855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : configmap references non-existent config key: service-ca.crt Jul 08 17:20:00.950983 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.950787 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs podName:5b017360-f84c-4fb3-9df1-0c1b56ac9265 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:16.950777911 +0000 UTC m=+67.409990424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs") pod "router-default-86758f94cf-kbj9q" (UID: "5b017360-f84c-4fb3-9df1-0c1b56ac9265") : secret "router-metrics-certs-default" not found Jul 08 17:20:00.950983 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:00.950804 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls podName:8427131a-881d-406b-b7b0-babe272e3b24 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:16.950796995 +0000 UTC m=+67.410009504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls") pod "dns-default-tvpn2" (UID: "8427131a-881d-406b-b7b0-babe272e3b24") : secret "dns-default-metrics-tls" not found Jul 08 17:20:02.702367 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:02.702331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:02.802496 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:02.802462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:03.945093 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:03.945054 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:04.382327 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:04.382231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:20:04.382503 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:04.382383 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:04.382503 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:04.382396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:20:04.382503 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:04.382451 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls podName:eea690ae-4ab3-43dc-959d-fba5c7d6e6d3 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:12.382434922 +0000 UTC m=+62.841647432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2ss7k" (UID: "eea690ae-4ab3-43dc-959d-fba5c7d6e6d3") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:04.382980 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:04.382959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:20:04.892698 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:04.892669 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:05.155921 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:05.155828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:05.304328 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:05.304297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:05.347538 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:05.347496 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:20:05.347710 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:05.347573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:20:05.348020 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:05.348004 2578 scope.go:117] "RemoveContainer" containerID="a4f0090fc6282141548dce593da0e1824d42fa506e859c467e8433107b775dd1" Jul 08 17:20:05.348200 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:05.348178 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-zqsgm_openshift-console-operator(f2026397-8006-4d0d-839e-d050b6080d09)\"" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" podUID="f2026397-8006-4d0d-839e-d050b6080d09" Jul 08 17:20:05.405439 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:05.405410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:05.639345 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:05.639309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:05.785972 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:05.785935 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:06.393564 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:06.393532 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:06.799247 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:06.799161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:06.995030 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:06.994985 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:07.049796 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:07.049716 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:07.590235 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:07.590194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:08.012194 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:08.012163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:08.428443 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:08.428408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:08.527452 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:08.527408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:08.713766 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:08.713672 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:08.816110 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:08.816065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:09.242411 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:09.242376 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:09.394511 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:09.394469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:09.495595 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:09.495490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:09.992458 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:09.992427 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:10.153844 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:10.153818 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ngt8k" Jul 08 17:20:10.596280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:10.596242 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:10.695404 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:10.695363 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:10.796352 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:10.796317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:10.856828 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:10.856750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:10.916953 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:10.916922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:10.990523 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:10.990489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:11.365287 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:11.365252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:11.428423 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:11.428392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:11.485123 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:11.485088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:11.991602 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:11.991561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:12.453029 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:12.452985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:20:12.455345 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:12.455322 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eea690ae-4ab3-43dc-959d-fba5c7d6e6d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2ss7k\" (UID: \"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3\") " pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:20:12.532112 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:12.532082 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bqdcg\"" Jul 08 17:20:12.539415 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:12.539396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2ss7k" Jul 08 17:20:12.594431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:12.594397 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:12.675529 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:12.675490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2ss7k"] Jul 08 17:20:12.678307 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:12.678278 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea690ae_4ab3_43dc_959d_fba5c7d6e6d3.slice/crio-d9651cad959643c63d25c53f6e73a6900ec809e0141249b46317673167e7e46d WatchSource:0}: Error finding container d9651cad959643c63d25c53f6e73a6900ec809e0141249b46317673167e7e46d: Status 404 returned error can't find the container with id d9651cad959643c63d25c53f6e73a6900ec809e0141249b46317673167e7e46d Jul 08 17:20:12.791834 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:12.791748 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:13.193196 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:13.193115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:13.298422 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:13.298344 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ss7k" event={"ID":"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3","Type":"ContainerStarted","Data":"d9651cad959643c63d25c53f6e73a6900ec809e0141249b46317673167e7e46d"} Jul 08 17:20:13.391036 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:13.390826 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:13.787756 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:13.787722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:14.392838 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:14.392803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:14.785686 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:14.785583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:15.189446 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.189410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:15.398263 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.398231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:15.591490 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.591400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:15.686680 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.686640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:20:15.689406 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.689381 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:20:15.700161 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.700128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a37ad3a8-2873-4048-9539-f94e08b4276c-original-pull-secret\") pod \"global-pull-secret-syncer-cnw5g\" (UID: \"a37ad3a8-2873-4048-9539-f94e08b4276c\") " pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:20:15.787645 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.787611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:20:15.790165 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.790142 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:20:15.800582 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.800550 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/788d0e28-8483-4168-bcba-4ea312a48c60-metrics-certs\") pod \"network-metrics-daemon-fwqpx\" (UID: \"788d0e28-8483-4168-bcba-4ea312a48c60\") " pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:20:15.889105 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.889059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:20:15.892253 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.892221 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9p4p\" (UniqueName: \"kubernetes.io/projected/a8171d08-14f1-4a39-853e-413e6039fa50-kube-api-access-l9p4p\") pod \"network-check-target-7wrzw\" (UID: \"a8171d08-14f1-4a39-853e-413e6039fa50\") " pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:20:15.922634 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.922603 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cnw5g" Jul 08 17:20:15.931367 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.931347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rq8b\"" Jul 08 17:20:15.939499 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.939479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:20:15.944012 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.943992 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7ksx\"" Jul 08 17:20:15.951965 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:15.951949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fwqpx" Jul 08 17:20:16.466813 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.451011 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cnw5g"] Jul 08 17:20:16.469659 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:16.469622 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37ad3a8_2873_4048_9539_f94e08b4276c.slice/crio-351f047abd5e14ade4621531bcd8957d34c28cf2d9d5c82cab61947353dc8e6d WatchSource:0}: Error finding container 351f047abd5e14ade4621531bcd8957d34c28cf2d9d5c82cab61947353dc8e6d: Status 404 returned error can't find the container with id 351f047abd5e14ade4621531bcd8957d34c28cf2d9d5c82cab61947353dc8e6d Jul 08 17:20:16.664278 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.664136 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fwqpx"] Jul 08 17:20:16.666734 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.666710 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7wrzw"] Jul 08 17:20:16.667013 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:16.666991 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod788d0e28_8483_4168_bcba_4ea312a48c60.slice/crio-8b95c68acee16b9f3d922c7ad35d8ba1cef7ced1389dfc6bd3827f85f2de86d7 WatchSource:0}: Error finding container 8b95c68acee16b9f3d922c7ad35d8ba1cef7ced1389dfc6bd3827f85f2de86d7: Status 404 returned error can't find the container with id 8b95c68acee16b9f3d922c7ad35d8ba1cef7ced1389dfc6bd3827f85f2de86d7 Jul 08 17:20:16.669681 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:16.669651 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8171d08_14f1_4a39_853e_413e6039fa50.slice/crio-95e9b5d2be21df7d37fabd7b9036fa87305f7e4483227a65651252dad789d06f WatchSource:0}: Error finding container 95e9b5d2be21df7d37fabd7b9036fa87305f7e4483227a65651252dad789d06f: Status 404 returned error can't find the container with id 95e9b5d2be21df7d37fabd7b9036fa87305f7e4483227a65651252dad789d06f Jul 08 17:20:16.898593 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.898555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:20:16.898776 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.898647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:20:16.898776 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.898736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:20:16.901450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.901423 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/945b5a8c-6b0c-4d8f-9e87-9ffd014621aa-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dc66h\" (UID: \"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:20:16.901450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.901435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"image-registry-7f75c4d5fc-84khb\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:20:16.901606 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.901435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/49028db6-f3b9-4a15-bcb6-6a181650330d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-gg5lg\" (UID: \"49028db6-f3b9-4a15-bcb6-6a181650330d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:20:16.999785 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.999758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:16.999896 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.999817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:16.999896 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.999868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:20:16.999980 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:16.999932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:20:17.000456 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.000428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b017360-f84c-4fb3-9df1-0c1b56ac9265-service-ca-bundle\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:17.002328 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.002306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8427131a-881d-406b-b7b0-babe272e3b24-metrics-tls\") pod \"dns-default-tvpn2\" (UID: \"8427131a-881d-406b-b7b0-babe272e3b24\") " pod="openshift-dns/dns-default-tvpn2" Jul 08 17:20:17.002658 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.002637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/55cd57c0-ee6d-4cbd-b5ed-c407d478d01e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-q9vmd\" (UID: \"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:20:17.002708 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.002632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b017360-f84c-4fb3-9df1-0c1b56ac9265-metrics-certs\") pod \"router-default-86758f94cf-kbj9q\" (UID: \"5b017360-f84c-4fb3-9df1-0c1b56ac9265\") " pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:17.036985 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.036958 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbqpz\"" Jul 08 17:20:17.045189 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.045168 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:20:17.098577 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.098479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t94t7\"" Jul 08 17:20:17.105566 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.105535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" Jul 08 17:20:17.137272 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.137216 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z9ktl\"" Jul 08 17:20:17.145375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.145330 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" Jul 08 17:20:17.161264 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.161238 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rc7v6\"" Jul 08 17:20:17.169934 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.169899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvpn2" Jul 08 17:20:17.175138 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.175052 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f75c4d5fc-84khb"] Jul 08 17:20:17.184950 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.184928 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hvscl\"" Jul 08 17:20:17.193152 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.193087 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:17.203811 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.203767 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-62xxc\"" Jul 08 17:20:17.211290 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.211249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" Jul 08 17:20:17.262729 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.262679 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg"] Jul 08 17:20:17.280367 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:17.280322 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49028db6_f3b9_4a15_bcb6_6a181650330d.slice/crio-6b31c90bc63cf9e9ce9cffc6be03602019bc61fbfd47e93aefd194dde35f13a3 WatchSource:0}: Error finding container 6b31c90bc63cf9e9ce9cffc6be03602019bc61fbfd47e93aefd194dde35f13a3: Status 404 returned error can't find the container with id 6b31c90bc63cf9e9ce9cffc6be03602019bc61fbfd47e93aefd194dde35f13a3 Jul 08 17:20:17.325880 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.325736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" event={"ID":"d42e96ab-8561-4ced-8000-c4dcd7cb5732","Type":"ContainerStarted","Data":"b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306"} Jul 08 17:20:17.325880 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.325799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" event={"ID":"d42e96ab-8561-4ced-8000-c4dcd7cb5732","Type":"ContainerStarted","Data":"bdd5167bbd1b1a58d25dc9b4be29c89ff9817012b649380255446854c6455efc"} Jul 08 17:20:17.326226 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.326174 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:20:17.328408 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.328168 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fwqpx" event={"ID":"788d0e28-8483-4168-bcba-4ea312a48c60","Type":"ContainerStarted","Data":"8b95c68acee16b9f3d922c7ad35d8ba1cef7ced1389dfc6bd3827f85f2de86d7"} Jul 08 17:20:17.329832 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.329774 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" event={"ID":"49028db6-f3b9-4a15-bcb6-6a181650330d","Type":"ContainerStarted","Data":"6b31c90bc63cf9e9ce9cffc6be03602019bc61fbfd47e93aefd194dde35f13a3"} Jul 08 17:20:17.333623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.333581 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h"] Jul 08 17:20:17.337430 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.337390 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7wrzw" event={"ID":"a8171d08-14f1-4a39-853e-413e6039fa50","Type":"ContainerStarted","Data":"4a740f3f4994031634f94e68811fc10dc372af16ff86f1fee05b93219aebc02f"} Jul 08 17:20:17.337724 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.337675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7wrzw" event={"ID":"a8171d08-14f1-4a39-853e-413e6039fa50","Type":"ContainerStarted","Data":"95e9b5d2be21df7d37fabd7b9036fa87305f7e4483227a65651252dad789d06f"} Jul 08 17:20:17.339306 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.339253 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:20:17.342624 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.342520 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ss7k" event={"ID":"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3","Type":"ContainerStarted","Data":"118ffafe009cd5ecf3e3dc930a64c1a9b8ed8084e89285d6888c9419df7047d8"} Jul 08 17:20:17.342624 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.342573 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ss7k" event={"ID":"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3","Type":"ContainerStarted","Data":"7bb07d041fdf5c8c6da7fe907af6fc68da22b166aade886faac0fbe4faf30716"} Jul 08 17:20:17.347156 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.347108 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" podStartSLOduration=67.347089492 podStartE2EDuration="1m7.347089492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:17.346398722 +0000 UTC m=+67.805611257" watchObservedRunningTime="2026-07-08 17:20:17.347089492 +0000 UTC m=+67.806302004" Jul 08 17:20:17.347309 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.347285 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cnw5g" event={"ID":"a37ad3a8-2873-4048-9539-f94e08b4276c","Type":"ContainerStarted","Data":"351f047abd5e14ade4621531bcd8957d34c28cf2d9d5c82cab61947353dc8e6d"} Jul 08 17:20:17.365950 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.365554 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7wrzw" podStartSLOduration=67.365531017 podStartE2EDuration="1m7.365531017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:17.3631648 +0000 UTC m=+67.822377334" watchObservedRunningTime="2026-07-08 17:20:17.365531017 +0000 UTC m=+67.824743550" Jul 08 17:20:17.366479 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.366416 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tvpn2"] Jul 08 17:20:17.410119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.410055 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86758f94cf-kbj9q"] Jul 08 17:20:17.412974 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:17.412943 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b017360_f84c_4fb3_9df1_0c1b56ac9265.slice/crio-0c00b1c4109bf43e0e91a55f5f7b6823a5311b039072efb07e4cc419a26e043b WatchSource:0}: Error finding container 0c00b1c4109bf43e0e91a55f5f7b6823a5311b039072efb07e4cc419a26e043b: Status 404 returned error can't find the container with id 0c00b1c4109bf43e0e91a55f5f7b6823a5311b039072efb07e4cc419a26e043b Jul 08 17:20:17.427552 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:17.427076 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd"] Jul 08 17:20:17.432133 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:17.432103 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cd57c0_ee6d_4cbd_b5ed_c407d478d01e.slice/crio-c761a4147e05a6ab9b97b5dc67107f6540fafb69fb682c70b92ec4c01aefae2b WatchSource:0}: Error finding container c761a4147e05a6ab9b97b5dc67107f6540fafb69fb682c70b92ec4c01aefae2b: Status 404 returned error can't find the container with id c761a4147e05a6ab9b97b5dc67107f6540fafb69fb682c70b92ec4c01aefae2b Jul 08 17:20:18.013569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.013250 2578 scope.go:117] "RemoveContainer" containerID="a4f0090fc6282141548dce593da0e1824d42fa506e859c467e8433107b775dd1" Jul 08 17:20:18.357448 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.356582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86758f94cf-kbj9q" event={"ID":"5b017360-f84c-4fb3-9df1-0c1b56ac9265","Type":"ContainerStarted","Data":"1a208360b9a16dacbf8e24f956c1c14d3e1915382e5bcf9184a72c578a5a8eb0"} Jul 08 17:20:18.357448 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.356648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86758f94cf-kbj9q" event={"ID":"5b017360-f84c-4fb3-9df1-0c1b56ac9265","Type":"ContainerStarted","Data":"0c00b1c4109bf43e0e91a55f5f7b6823a5311b039072efb07e4cc419a26e043b"} Jul 08 17:20:18.360925 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.360894 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvpn2" event={"ID":"8427131a-881d-406b-b7b0-babe272e3b24","Type":"ContainerStarted","Data":"01ac0ea6c0700705e7da90a3b5fe8ef0cb648630a5253de33e59ae0dda335755"} Jul 08 17:20:18.365970 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.365889 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:20:18.366115 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.365984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" event={"ID":"f2026397-8006-4d0d-839e-d050b6080d09","Type":"ContainerStarted","Data":"5b28ea3cdb6c88432bce05e4009b6650fc2a9fb04e130e0343fd3ac7ea0333c5"} Jul 08 17:20:18.368346 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.368256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" event={"ID":"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa","Type":"ContainerStarted","Data":"045d006e6493c60670e679eebcd8aaa1ad6d6f7cb4974eba85266ae7c310d827"} Jul 08 17:20:18.370517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.369088 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:20:18.371027 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.370718 2578 patch_prober.go:28] interesting pod/console-operator-68b757fb67-zqsgm container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Jul 08 17:20:18.371027 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.370772 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" podUID="f2026397-8006-4d0d-839e-d050b6080d09" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.15:8443/readyz\": dial tcp 10.132.0.15:8443: connect: connection refused" Jul 08 17:20:18.376366 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.376107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" event={"ID":"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e","Type":"ContainerStarted","Data":"c761a4147e05a6ab9b97b5dc67107f6540fafb69fb682c70b92ec4c01aefae2b"} Jul 08 17:20:18.382104 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.381409 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-86758f94cf-kbj9q" podStartSLOduration=56.381391098 podStartE2EDuration="56.381391098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:18.379533939 +0000 UTC m=+68.838746473" watchObservedRunningTime="2026-07-08 17:20:18.381391098 +0000 UTC m=+68.840603633" Jul 08 17:20:18.399443 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:18.398351 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" podStartSLOduration=46.730936276 podStartE2EDuration="56.398331222s" totalImagesPullingTime="9.667394946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:18.397989491 +0000 UTC m=+68.857202021" watchObservedRunningTime="2026-07-08 17:20:18.398331222 +0000 UTC m=+68.857543755" Jul 08 17:20:19.004365 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.004264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:19.104382 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.104336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:19.194548 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.194185 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:19.197430 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.197406 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:19.384539 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.384436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fwqpx" event={"ID":"788d0e28-8483-4168-bcba-4ea312a48c60","Type":"ContainerStarted","Data":"a6459542f6f2651ebc9f848fb3f007887cfb36f968daec0da4598ee8a0e2b5f1"} Jul 08 17:20:19.384539 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.384501 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fwqpx" event={"ID":"788d0e28-8483-4168-bcba-4ea312a48c60","Type":"ContainerStarted","Data":"46fe12c1e36ec24cb47087dc75b11e09587f4b8f5ca34eeb3c32123a8580a278"} Jul 08 17:20:19.385989 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.385963 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:19.386483 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.386431 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86758f94cf-kbj9q" Jul 08 17:20:19.393611 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.393590 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-zqsgm" Jul 08 17:20:19.416243 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.414987 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fwqpx" podStartSLOduration=67.829986303 podStartE2EDuration="1m9.414966359s" totalImagesPullingTime="1.584980056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:19.414375972 +0000 UTC m=+69.873588505" watchObservedRunningTime="2026-07-08 17:20:19.414966359 +0000 UTC m=+69.874178892" Jul 08 17:20:19.522643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.522382 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:19.643234 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.643195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:19.742312 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.742282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:19.847421 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.847115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:19.946457 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:19.946374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:20.039139 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:20.039103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:20.126497 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:20.126440 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:20.653557 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:20.653524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:20.851831 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:20.851795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:21.126057 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:21.125957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:21.458524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:21.458493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:21.523820 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:21.523787 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:23.882827 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:23.882795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:23.942363 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:23.942284 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:25.115902 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.115795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:25.210376 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.210332 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:25.277145 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.277110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:25.410668 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.410632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" event={"ID":"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa","Type":"ContainerStarted","Data":"12becbb8e234fda9eb964ba5e296b9700e531fbd9368d9b42a7753eb0cccb9c4"} Jul 08 17:20:25.410867 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.410731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" event={"ID":"945b5a8c-6b0c-4d8f-9e87-9ffd014621aa","Type":"ContainerStarted","Data":"180114caab303bb05835e1ec222dd7ea5da1207369473d4d883696e264638873"} Jul 08 17:20:25.412943 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.412913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2ss7k" event={"ID":"eea690ae-4ab3-43dc-959d-fba5c7d6e6d3","Type":"ContainerStarted","Data":"7bf853a76af1d2d342ca8f73fb4d9f6ebbb4f24e3287f351d6ff16417054ab0e"} Jul 08 17:20:25.415150 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.414726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" event={"ID":"55cd57c0-ee6d-4cbd-b5ed-c407d478d01e","Type":"ContainerStarted","Data":"8726918083a9b805ab330ad2a5249c89fa1bb3467dfab9449245cdbf56247ebd"} Jul 08 17:20:25.416348 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.416323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" event={"ID":"49028db6-f3b9-4a15-bcb6-6a181650330d","Type":"ContainerStarted","Data":"d9c40b84f7579e01baf04c79eb0f2682d47524a578772df50666cdda84a751fd"} Jul 08 17:20:25.418098 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.418076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvpn2" event={"ID":"8427131a-881d-406b-b7b0-babe272e3b24","Type":"ContainerStarted","Data":"954dc48d5ec8e3ff98ebb5867dfe21dd779d5c9c9ad999aedfe3059b825e7d20"} Jul 08 17:20:25.418201 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.418112 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvpn2" event={"ID":"8427131a-881d-406b-b7b0-babe272e3b24","Type":"ContainerStarted","Data":"bb104da3f46fdd904e65344737cf73ba82a12d5d229cd03597a5c26cd324d9ed"} Jul 08 17:20:25.418201 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.418140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tvpn2" Jul 08 17:20:25.419654 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.419620 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cnw5g" event={"ID":"a37ad3a8-2873-4048-9539-f94e08b4276c","Type":"ContainerStarted","Data":"8e07989c64d0eb2f34552cd3556b9358e9034173246383a3a96c89669f61f8fb"} Jul 08 17:20:25.435951 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.435903 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dc66h" podStartSLOduration=57.373593334 podStartE2EDuration="1m4.435888531s" totalImagesPullingTime="7.062295197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:25.435276042 +0000 UTC m=+75.894488576" watchObservedRunningTime="2026-07-08 17:20:25.435888531 +0000 UTC m=+75.895101090" Jul 08 17:20:25.453792 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.453723 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cnw5g" podStartSLOduration=67.216820885 podStartE2EDuration="1m15.453709507s" totalImagesPullingTime="8.236888622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:25.453547276 +0000 UTC m=+75.912759815" watchObservedRunningTime="2026-07-08 17:20:25.453709507 +0000 UTC m=+75.912922082" Jul 08 17:20:25.473068 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.473021 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-q9vmd" podStartSLOduration=48.44569157 podStartE2EDuration="55.473005139s" totalImagesPullingTime="7.027313569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:25.472723582 +0000 UTC m=+75.931936115" watchObservedRunningTime="2026-07-08 17:20:25.473005139 +0000 UTC m=+75.932217670" Jul 08 17:20:25.474204 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.474168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:25.496786 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.496733 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-gg5lg" podStartSLOduration=57.321228179 podStartE2EDuration="1m4.496716895s" totalImagesPullingTime="7.175488716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:25.496340033 +0000 UTC m=+75.955552568" watchObservedRunningTime="2026-07-08 17:20:25.496716895 +0000 UTC m=+75.955929431" Jul 08 17:20:25.516144 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.516095 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2ss7k" podStartSLOduration=17.868060124 podStartE2EDuration="29.51607839s" totalImagesPullingTime="11.648018266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:19:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:25.515310084 +0000 UTC m=+75.974522616" watchObservedRunningTime="2026-07-08 17:20:25.51607839 +0000 UTC m=+75.975290972" Jul 08 17:20:25.538394 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.538339 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tvpn2" podStartSLOduration=34.472502558 podStartE2EDuration="41.538319197s" totalImagesPullingTime="7.065816639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:25.537550499 +0000 UTC m=+75.996763037" watchObservedRunningTime="2026-07-08 17:20:25.538319197 +0000 UTC m=+75.997531730" Jul 08 17:20:25.589495 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.589454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:25.709393 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:25.709300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:26.211117 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:26.211079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:26.268623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:26.268597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:27.865011 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:27.864971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:27.935843 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:27.935800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:29.312510 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:29.312475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:29.396607 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:29.396568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:29.552082 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:29.552053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:30.076229 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:30.076193 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:30.146287 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:30.146248 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:30.273559 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:30.273524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:30.376801 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:30.376716 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:31.007398 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:31.007359 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:31.102998 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:31.102958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:32.193674 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:32.193633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:32.921687 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:32.921659 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:33.012697 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:33.012669 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:34.469400 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.469366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:34.572046 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.572012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:34.748016 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.747933 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:34.776641 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.776605 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-52z6q"] Jul 08 17:20:34.780351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.780329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.785228 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.785202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 17:20:34.786342 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.786322 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 17:20:34.786449 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.786338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 17:20:34.786449 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.786387 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 17:20:34.786449 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.786440 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cvxn8\"" Jul 08 17:20:34.856500 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-sys\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.856500 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-accelerators-collector-config\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.856694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.856694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-textfile\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.856694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.856694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-wtmp\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.856694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k94kp\" (UniqueName: \"kubernetes.io/projected/454b33d9-6565-479e-9fb7-3feda628c3a3-kube-api-access-k94kp\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.856694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454b33d9-6565-479e-9fb7-3feda628c3a3-metrics-client-ca\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.856897 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.856711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-root\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.919762 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.919733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:34.957867 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.957817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-root\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958001 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.957927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-root\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958001 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.957969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-sys\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958001 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.957999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-accelerators-collector-config\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958129 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958129 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958051 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-sys\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958129 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-textfile\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958129 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958290 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:34.958137 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 17:20:34.958290 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:34.958188 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls podName:454b33d9-6565-479e-9fb7-3feda628c3a3 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:35.45816988 +0000 UTC m=+85.917382390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls") pod "node-exporter-52z6q" (UID: "454b33d9-6565-479e-9fb7-3feda628c3a3") : secret "node-exporter-tls" not found Jul 08 17:20:34.958290 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-wtmp\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958290 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-wtmp\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958290 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k94kp\" (UniqueName: \"kubernetes.io/projected/454b33d9-6565-479e-9fb7-3feda628c3a3-kube-api-access-k94kp\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958540 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454b33d9-6565-479e-9fb7-3feda628c3a3-metrics-client-ca\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958592 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-textfile\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958642 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-accelerators-collector-config\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.958788 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.958769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454b33d9-6565-479e-9fb7-3feda628c3a3-metrics-client-ca\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.960413 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.960386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:34.968322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:34.968302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k94kp\" (UniqueName: \"kubernetes.io/projected/454b33d9-6565-479e-9fb7-3feda628c3a3-kube-api-access-k94kp\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:35.012471 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.012385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:35.111728 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.111694 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:35.256026 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.255994 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:35.362315 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.362216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:35.425471 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.425447 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tvpn2" Jul 08 17:20:35.463283 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.463250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:35.463663 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:35.463629 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 17:20:35.463816 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:20:35.463706 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls podName:454b33d9-6565-479e-9fb7-3feda628c3a3 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:36.463688297 +0000 UTC m=+86.922900814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls") pod "node-exporter-52z6q" (UID: "454b33d9-6565-479e-9fb7-3feda628c3a3") : secret "node-exporter-tls" not found Jul 08 17:20:35.554656 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.554626 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:35.684989 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.684950 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:35.807300 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.807262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:35.901046 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:35.901009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:36.017569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:36.017456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:36.187587 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:36.187554 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:36.249964 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:36.249928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:36.471522 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:36.471489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:36.473780 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:36.473754 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/454b33d9-6565-479e-9fb7-3feda628c3a3-node-exporter-tls\") pod \"node-exporter-52z6q\" (UID: \"454b33d9-6565-479e-9fb7-3feda628c3a3\") " pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:36.589242 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:36.589200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-52z6q" Jul 08 17:20:36.599306 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:36.599282 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454b33d9_6565_479e_9fb7_3feda628c3a3.slice/crio-831305d008b006c39cf1769371951ec9d735d6d5a3f2b2f38be15e49d504edd1 WatchSource:0}: Error finding container 831305d008b006c39cf1769371951ec9d735d6d5a3f2b2f38be15e49d504edd1: Status 404 returned error can't find the container with id 831305d008b006c39cf1769371951ec9d735d6d5a3f2b2f38be15e49d504edd1 Jul 08 17:20:37.050157 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:37.050121 2578 patch_prober.go:28] interesting pod/image-registry-7f75c4d5fc-84khb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:20:37.050340 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:37.050184 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" podUID="d42e96ab-8561-4ced-8000-c4dcd7cb5732" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:20:37.465025 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:37.464991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52z6q" event={"ID":"454b33d9-6565-479e-9fb7-3feda628c3a3","Type":"ContainerStarted","Data":"831305d008b006c39cf1769371951ec9d735d6d5a3f2b2f38be15e49d504edd1"} Jul 08 17:20:37.675466 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:37.675429 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:37.776003 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:37.775958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:38.116887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.116743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:38.277088 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.277048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:38.381344 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.381271 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:20:38.469834 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.469800 2578 generic.go:356] "Generic (PLEG): container finished" podID="454b33d9-6565-479e-9fb7-3feda628c3a3" containerID="e6f03122928d03b34aa209887791a466fb2eadcdadb78ddac42d4e4acb365312" exitCode=0 Jul 08 17:20:38.470017 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.469882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52z6q" event={"ID":"454b33d9-6565-479e-9fb7-3feda628c3a3","Type":"ContainerDied","Data":"e6f03122928d03b34aa209887791a466fb2eadcdadb78ddac42d4e4acb365312"} Jul 08 17:20:38.612682 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.612649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:38.710470 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.710431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:38.811868 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.811819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:38.997551 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:38.997453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:39.084756 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:39.084720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:39.475627 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:39.475596 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52z6q" event={"ID":"454b33d9-6565-479e-9fb7-3feda628c3a3","Type":"ContainerStarted","Data":"0988de4aac03eeea862ba8f747061b12316c3b33f87ffa561fec332d3d5c2dec"} Jul 08 17:20:39.475794 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:39.475648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52z6q" event={"ID":"454b33d9-6565-479e-9fb7-3feda628c3a3","Type":"ContainerStarted","Data":"4be4597aaad7212f329d77aa7d05a524786a23fe181a1437c720c412b6f4fd1a"} Jul 08 17:20:39.498878 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:39.498817 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-52z6q" podStartSLOduration=4.397194852 podStartE2EDuration="5.498801447s" totalImagesPullingTime="1.037720451s" totalInitContainerRuntime="63.886144ms" isStatefulPod=true podCreationTimestamp="2026-07-08 17:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:39.497733291 +0000 UTC m=+89.956945823" watchObservedRunningTime="2026-07-08 17:20:39.498801447 +0000 UTC m=+89.958013979" Jul 08 17:20:39.525146 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:39.525113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:39.619705 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:39.619672 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:40.202718 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:40.202680 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:40.994292 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:40.994263 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:41.265767 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:41.265683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:41.365863 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:41.365814 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:41.940072 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:41.940034 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f75c4d5fc-84khb"] Jul 08 17:20:42.169187 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:42.169148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:42.375414 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:42.375331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:46.097219 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:46.097186 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:46.201211 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:46.201179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:47.970196 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:47.970161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:48.211206 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:48.211173 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:48.311245 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:48.311161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:48.378689 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:48.378662 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7wrzw" Jul 08 17:20:49.122756 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:49.122724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:49.224551 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:49.224519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:50.423146 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.423106 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:50.482898 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.482848 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f"] Jul 08 17:20:50.499125 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.499098 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f"] Jul 08 17:20:50.499265 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.499199 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.501799 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.501774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 17:20:50.502844 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.502829 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 17:20:50.503185 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.503159 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 17:20:50.503311 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.503294 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 17:20:50.519567 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.519539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:50.585212 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.585183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-klusterlet-config\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.585363 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.585228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-tmp\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.585363 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.585264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfsx5\" (UniqueName: \"kubernetes.io/projected/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-kube-api-access-lfsx5\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.685681 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.685610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-klusterlet-config\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.685681 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.685647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-tmp\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.685681 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.685673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfsx5\" (UniqueName: \"kubernetes.io/projected/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-kube-api-access-lfsx5\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.686029 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.686010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-tmp\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.688303 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.688271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-klusterlet-config\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.694125 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.694102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfsx5\" (UniqueName: \"kubernetes.io/projected/1e2da312-7c7a-4b2c-b4bf-600b1db7684b-kube-api-access-lfsx5\") pod \"klusterlet-addon-workmgr-65d665dc67-82j7f\" (UID: \"1e2da312-7c7a-4b2c-b4bf-600b1db7684b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.726723 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.726687 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:50.808680 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.808647 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:50.835869 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.831317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:50.951929 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:50.951831 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f"] Jul 08 17:20:50.954619 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:20:50.954594 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2da312_7c7a_4b2c_b4bf_600b1db7684b.slice/crio-df1ff127dadc782e0e591e5fbe9eab1c69264bacdebc2c2899348d52ce014359 WatchSource:0}: Error finding container df1ff127dadc782e0e591e5fbe9eab1c69264bacdebc2c2899348d52ce014359: Status 404 returned error can't find the container with id df1ff127dadc782e0e591e5fbe9eab1c69264bacdebc2c2899348d52ce014359 Jul 08 17:20:51.521019 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:51.520986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" event={"ID":"1e2da312-7c7a-4b2c-b4bf-600b1db7684b","Type":"ContainerStarted","Data":"df1ff127dadc782e0e591e5fbe9eab1c69264bacdebc2c2899348d52ce014359"} Jul 08 17:20:55.539432 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:55.539399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" event={"ID":"1e2da312-7c7a-4b2c-b4bf-600b1db7684b","Type":"ContainerStarted","Data":"5c9af16d27b1bc32e2fca36e83e92ed87f0410070437efe179018e4882042a20"} Jul 08 17:20:55.539918 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:55.539623 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:55.541209 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:55.541190 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" Jul 08 17:20:55.556287 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:55.556239 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65d665dc67-82j7f" podStartSLOduration=1.4229564909999999 podStartE2EDuration="5.556225688s" totalImagesPullingTime="4.133269197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:55.554632945 +0000 UTC m=+106.013845476" watchObservedRunningTime="2026-07-08 17:20:55.556225688 +0000 UTC m=+106.015438220" Jul 08 17:20:56.212741 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:56.212710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:56.313557 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:56.313512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:56.414279 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:56.414249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:57.203335 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:57.203302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:57.303995 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:57.303957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:20:59.845933 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:20:59.845892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:06.036232 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:06.036195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:06.959379 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:06.959342 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" podUID="d42e96ab-8561-4ced-8000-c4dcd7cb5732" containerName="registry" containerID="cri-o://b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306" gracePeriod=30 Jul 08 17:21:07.202163 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.202139 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:21:07.324976 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.324885 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-image-registry-private-configuration\") pod \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " Jul 08 17:21:07.324976 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.324943 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") pod \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " Jul 08 17:21:07.324976 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.324965 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-installation-pull-secrets\") pod \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " Jul 08 17:21:07.325270 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.324996 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-certificates\") pod \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " Jul 08 17:21:07.325270 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.325021 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4t82\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-kube-api-access-g4t82\") pod \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " Jul 08 17:21:07.325270 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.325050 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-trusted-ca\") pod \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " Jul 08 17:21:07.325270 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.325092 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d42e96ab-8561-4ced-8000-c4dcd7cb5732-ca-trust-extracted\") pod \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " Jul 08 17:21:07.325270 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.325133 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-bound-sa-token\") pod \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\" (UID: \"d42e96ab-8561-4ced-8000-c4dcd7cb5732\") " Jul 08 17:21:07.325532 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.325484 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d42e96ab-8561-4ced-8000-c4dcd7cb5732" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:21:07.325589 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.325537 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d42e96ab-8561-4ced-8000-c4dcd7cb5732" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:21:07.327487 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.327460 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d42e96ab-8561-4ced-8000-c4dcd7cb5732" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:21:07.327615 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.327481 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-kube-api-access-g4t82" (OuterVolumeSpecName: "kube-api-access-g4t82") pod "d42e96ab-8561-4ced-8000-c4dcd7cb5732" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732"). InnerVolumeSpecName "kube-api-access-g4t82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:21:07.327615 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.327598 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d42e96ab-8561-4ced-8000-c4dcd7cb5732" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:21:07.327704 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.327654 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d42e96ab-8561-4ced-8000-c4dcd7cb5732" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:21:07.327748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.327729 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d42e96ab-8561-4ced-8000-c4dcd7cb5732" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:21:07.333630 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.333606 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42e96ab-8561-4ced-8000-c4dcd7cb5732-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d42e96ab-8561-4ced-8000-c4dcd7cb5732" (UID: "d42e96ab-8561-4ced-8000-c4dcd7cb5732"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:21:07.426086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.426048 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-image-registry-private-configuration\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:21:07.426086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.426080 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-tls\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:21:07.426086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.426092 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d42e96ab-8561-4ced-8000-c4dcd7cb5732-installation-pull-secrets\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:21:07.426322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.426102 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-registry-certificates\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:21:07.426322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.426110 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4t82\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-kube-api-access-g4t82\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:21:07.426322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.426118 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d42e96ab-8561-4ced-8000-c4dcd7cb5732-trusted-ca\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:21:07.426322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.426126 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d42e96ab-8561-4ced-8000-c4dcd7cb5732-ca-trust-extracted\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:21:07.426322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.426134 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d42e96ab-8561-4ced-8000-c4dcd7cb5732-bound-sa-token\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:21:07.587716 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.587624 2578 generic.go:356] "Generic (PLEG): container finished" podID="d42e96ab-8561-4ced-8000-c4dcd7cb5732" containerID="b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306" exitCode=0 Jul 08 17:21:07.587716 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.587677 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" Jul 08 17:21:07.587716 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.587705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" event={"ID":"d42e96ab-8561-4ced-8000-c4dcd7cb5732","Type":"ContainerDied","Data":"b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306"} Jul 08 17:21:07.587965 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.587775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f75c4d5fc-84khb" event={"ID":"d42e96ab-8561-4ced-8000-c4dcd7cb5732","Type":"ContainerDied","Data":"bdd5167bbd1b1a58d25dc9b4be29c89ff9817012b649380255446854c6455efc"} Jul 08 17:21:07.587965 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.587795 2578 scope.go:117] "RemoveContainer" containerID="b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306" Jul 08 17:21:07.596234 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.596214 2578 scope.go:117] "RemoveContainer" containerID="b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306" Jul 08 17:21:07.596516 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:21:07.596498 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306\": container with ID starting with b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306 not found: ID does not exist" containerID="b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306" Jul 08 17:21:07.596569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.596522 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306"} err="failed to get container status \"b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306\": rpc error: code = NotFound desc = could not find container \"b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306\": container with ID starting with b3ba05379ccb52b6a6a4f82885d0be1707842aabd3a44ee9e0d88b4870a28306 not found: ID does not exist" Jul 08 17:21:07.610763 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.610739 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f75c4d5fc-84khb"] Jul 08 17:21:07.615453 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:07.615435 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f75c4d5fc-84khb"] Jul 08 17:21:08.011055 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:08.011024 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42e96ab-8561-4ced-8000-c4dcd7cb5732" path="/var/lib/kubelet/pods/d42e96ab-8561-4ced-8000-c4dcd7cb5732/volumes" Jul 08 17:21:11.206053 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:11.206012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:11.262626 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:11.262584 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:11.603391 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:11.603355 2578 generic.go:356] "Generic (PLEG): container finished" podID="402eb9e5-0f3b-43f3-98c7-19053fdc6a5e" containerID="e8a69e14eda0574ba1f5095463a4fe9a35a4b487f6db31eadc3d25b1d74e65f0" exitCode=0 Jul 08 17:21:11.603555 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:11.603428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" event={"ID":"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e","Type":"ContainerDied","Data":"e8a69e14eda0574ba1f5095463a4fe9a35a4b487f6db31eadc3d25b1d74e65f0"} Jul 08 17:21:11.603806 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:11.603791 2578 scope.go:117] "RemoveContainer" containerID="e8a69e14eda0574ba1f5095463a4fe9a35a4b487f6db31eadc3d25b1d74e65f0" Jul 08 17:21:12.118767 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:12.118735 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86758f94cf-kbj9q_5b017360-f84c-4fb3-9df1-0c1b56ac9265/router/0.log" Jul 08 17:21:12.131141 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:12.131098 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dsdxq_25abc86d-e249-4ab8-9c88-3cbb563c8664/serve-healthcheck-canary/0.log" Jul 08 17:21:12.608784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:12.608752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-zpcl8" event={"ID":"402eb9e5-0f3b-43f3-98c7-19053fdc6a5e","Type":"ContainerStarted","Data":"8d792ba521060632529143356e52cab6daefd0d38159805055ba347dcb650c43"} Jul 08 17:21:13.181419 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:13.181377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:13.280680 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:13.280645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:16.630426 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:16.630343 2578 generic.go:356] "Generic (PLEG): container finished" podID="3747ac00-416a-45ff-99b6-faa367ebd332" containerID="1f104616aa7cc91f07912c963c4faf9dfbda5fb9bc36bb8d0322ff8974fdda3b" exitCode=0 Jul 08 17:21:16.630426 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:16.630410 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" event={"ID":"3747ac00-416a-45ff-99b6-faa367ebd332","Type":"ContainerDied","Data":"1f104616aa7cc91f07912c963c4faf9dfbda5fb9bc36bb8d0322ff8974fdda3b"} Jul 08 17:21:16.630807 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:16.630741 2578 scope.go:117] "RemoveContainer" containerID="1f104616aa7cc91f07912c963c4faf9dfbda5fb9bc36bb8d0322ff8974fdda3b" Jul 08 17:21:17.635326 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:17.635296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bb8wp" event={"ID":"3747ac00-416a-45ff-99b6-faa367ebd332","Type":"ContainerStarted","Data":"6e198a1079dff4c0b499fe376140d6f23c5c31f2dd3548f3a803d5b0cac1255f"} Jul 08 17:21:18.837479 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:18.837441 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:18.938709 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:18.938669 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:18.996191 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:18.996149 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:28.384757 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:28.384718 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:31.691502 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:31.691469 2578 generic.go:356] "Generic (PLEG): container finished" podID="2951c345-cc7f-472d-a1a1-7372286fd28f" containerID="028b6700c64790232e984b716cfc8a03c9a02b839f8cb92a18bfeb121fb7d6df" exitCode=0 Jul 08 17:21:31.691898 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:31.691547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" event={"ID":"2951c345-cc7f-472d-a1a1-7372286fd28f","Type":"ContainerDied","Data":"028b6700c64790232e984b716cfc8a03c9a02b839f8cb92a18bfeb121fb7d6df"} Jul 08 17:21:31.691948 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:31.691929 2578 scope.go:117] "RemoveContainer" containerID="028b6700c64790232e984b716cfc8a03c9a02b839f8cb92a18bfeb121fb7d6df" Jul 08 17:21:32.696862 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:32.696826 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wjm2t" event={"ID":"2951c345-cc7f-472d-a1a1-7372286fd28f","Type":"ContainerStarted","Data":"5036bc7f054d8e48b2e34309dcb1fd6bd9f73916affb6c59aec8269e804d9db2"} Jul 08 17:21:48.713101 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:48.713018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:53.958424 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:53.958386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:21:54.364904 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:21:54.364812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:03.487441 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:22:03.487358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:03.568918 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:22:03.568848 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:14.813533 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:22:14.813494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:14.910338 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:22:14.910305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:14.982748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:22:14.982709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:40.784986 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:22:40.784926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:42.309961 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:22:42.309920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:22:42.444231 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:22:42.444195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:09.286482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:09.286439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:09.351614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:09.351572 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:19.231635 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:19.231594 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:19.300780 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:19.300745 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:21.254019 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:21.253982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:21.305686 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:21.305650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:26.213507 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:26.213471 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:26.315829 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:26.315790 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:29.765728 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:29.765691 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:29.825617 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:29.825575 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:29.886903 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:29.886844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:55.284740 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:55.284708 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:55.385979 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:55.385944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:23:56.049210 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.049170 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q"] Jul 08 17:23:56.049544 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.049527 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42e96ab-8561-4ced-8000-c4dcd7cb5732" containerName="registry" Jul 08 17:23:56.049625 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.049547 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42e96ab-8561-4ced-8000-c4dcd7cb5732" containerName="registry" Jul 08 17:23:56.049681 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.049623 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42e96ab-8561-4ced-8000-c4dcd7cb5732" containerName="registry" Jul 08 17:23:56.051571 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.051548 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.054154 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.054130 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 17:23:56.054321 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.054303 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 17:23:56.055254 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.055237 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vnltw\"" Jul 08 17:23:56.063586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.063565 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q"] Jul 08 17:23:56.212564 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.212532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwvwb\" (UniqueName: \"kubernetes.io/projected/ca6cee8f-5b49-4c77-b222-4941019f6638-kube-api-access-kwvwb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.212564 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.212567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.212781 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.212596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.313954 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.313848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwvwb\" (UniqueName: \"kubernetes.io/projected/ca6cee8f-5b49-4c77-b222-4941019f6638-kube-api-access-kwvwb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.313954 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.313910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.313954 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.313930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.314398 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.314247 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.314398 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.314264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.323234 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.323212 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwvwb\" (UniqueName: \"kubernetes.io/projected/ca6cee8f-5b49-4c77-b222-4941019f6638-kube-api-access-kwvwb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.360374 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.360338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:23:56.490514 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:56.490416 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q"] Jul 08 17:23:56.492637 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:23:56.492599 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6cee8f_5b49_4c77_b222_4941019f6638.slice/crio-b786d05c6e9bc9519f1519ef8609056e965e2758358251bcfed75475024d43af WatchSource:0}: Error finding container b786d05c6e9bc9519f1519ef8609056e965e2758358251bcfed75475024d43af: Status 404 returned error can't find the container with id b786d05c6e9bc9519f1519ef8609056e965e2758358251bcfed75475024d43af Jul 08 17:23:57.214981 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:23:57.214940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" event={"ID":"ca6cee8f-5b49-4c77-b222-4941019f6638","Type":"ContainerStarted","Data":"b786d05c6e9bc9519f1519ef8609056e965e2758358251bcfed75475024d43af"} Jul 08 17:24:06.253356 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:06.253263 2578 generic.go:356] "Generic (PLEG): container finished" podID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerID="534585ae197c98bf87453cef266ddd41f332a5a633908539181b6993bdcd4173" exitCode=0 Jul 08 17:24:06.253356 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:06.253340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" event={"ID":"ca6cee8f-5b49-4c77-b222-4941019f6638","Type":"ContainerDied","Data":"534585ae197c98bf87453cef266ddd41f332a5a633908539181b6993bdcd4173"} Jul 08 17:24:09.909438 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:09.909408 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:24:09.912603 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:09.912582 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:24:09.919958 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:09.919938 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 17:24:30.487696 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:30.487656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:31.880629 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:31.880594 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:38.374419 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:38.374384 2578 generic.go:356] "Generic (PLEG): container finished" podID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerID="426a9516c28c484eca09a255c264503d6e5c1d4a8f73fdb99dae4e6e69735ff3" exitCode=0 Jul 08 17:24:38.374812 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:38.374468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" event={"ID":"ca6cee8f-5b49-4c77-b222-4941019f6638","Type":"ContainerDied","Data":"426a9516c28c484eca09a255c264503d6e5c1d4a8f73fdb99dae4e6e69735ff3"} Jul 08 17:24:38.375366 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:38.375352 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:24:47.411436 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:47.411396 2578 generic.go:356] "Generic (PLEG): container finished" podID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerID="9757c1166061bd5c20e680062d2e46856e81b78a7c8a43e4f509c028d83ac2f0" exitCode=0 Jul 08 17:24:47.411801 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:47.411479 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" event={"ID":"ca6cee8f-5b49-4c77-b222-4941019f6638","Type":"ContainerDied","Data":"9757c1166061bd5c20e680062d2e46856e81b78a7c8a43e4f509c028d83ac2f0"} Jul 08 17:24:48.544959 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.544929 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:24:48.644451 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.644418 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-bundle\") pod \"ca6cee8f-5b49-4c77-b222-4941019f6638\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " Jul 08 17:24:48.644623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.644480 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-util\") pod \"ca6cee8f-5b49-4c77-b222-4941019f6638\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " Jul 08 17:24:48.644623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.644513 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwvwb\" (UniqueName: \"kubernetes.io/projected/ca6cee8f-5b49-4c77-b222-4941019f6638-kube-api-access-kwvwb\") pod \"ca6cee8f-5b49-4c77-b222-4941019f6638\" (UID: \"ca6cee8f-5b49-4c77-b222-4941019f6638\") " Jul 08 17:24:48.645082 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.645046 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-bundle" (OuterVolumeSpecName: "bundle") pod "ca6cee8f-5b49-4c77-b222-4941019f6638" (UID: "ca6cee8f-5b49-4c77-b222-4941019f6638"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:24:48.646633 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.646610 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca6cee8f-5b49-4c77-b222-4941019f6638-kube-api-access-kwvwb" (OuterVolumeSpecName: "kube-api-access-kwvwb") pod "ca6cee8f-5b49-4c77-b222-4941019f6638" (UID: "ca6cee8f-5b49-4c77-b222-4941019f6638"). InnerVolumeSpecName "kube-api-access-kwvwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:24:48.650421 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.650395 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-util" (OuterVolumeSpecName: "util") pod "ca6cee8f-5b49-4c77-b222-4941019f6638" (UID: "ca6cee8f-5b49-4c77-b222-4941019f6638"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:24:48.745186 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.745105 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-util\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:24:48.745186 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.745135 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwvwb\" (UniqueName: \"kubernetes.io/projected/ca6cee8f-5b49-4c77-b222-4941019f6638-kube-api-access-kwvwb\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:24:48.745186 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:48.745147 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca6cee8f-5b49-4c77-b222-4941019f6638-bundle\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:24:49.420150 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:49.420122 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" Jul 08 17:24:49.420150 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:49.420133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409b78q" event={"ID":"ca6cee8f-5b49-4c77-b222-4941019f6638","Type":"ContainerDied","Data":"b786d05c6e9bc9519f1519ef8609056e965e2758358251bcfed75475024d43af"} Jul 08 17:24:49.420356 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:49.420181 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b786d05c6e9bc9519f1519ef8609056e965e2758358251bcfed75475024d43af" Jul 08 17:24:52.419429 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:52.419394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:53.381729 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:53.381693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:54.373120 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.373082 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6"] Jul 08 17:24:54.373569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.373390 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerName="util" Jul 08 17:24:54.373569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.373406 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerName="util" Jul 08 17:24:54.373569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.373430 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerName="extract" Jul 08 17:24:54.373569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.373438 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerName="extract" Jul 08 17:24:54.373569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.373454 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerName="pull" Jul 08 17:24:54.373569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.373462 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerName="pull" Jul 08 17:24:54.373569 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.373547 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca6cee8f-5b49-4c77-b222-4941019f6638" containerName="extract" Jul 08 17:24:54.376658 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.376642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" Jul 08 17:24:54.379635 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.379616 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 17:24:54.379750 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.379620 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:24:54.379750 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.379661 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gnrsq\"" Jul 08 17:24:54.389761 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.389738 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6"] Jul 08 17:24:54.491204 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.491169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c1638e5-8aea-466f-bcde-9d1eb540dddd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxfq6\" (UID: \"2c1638e5-8aea-466f-bcde-9d1eb540dddd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" Jul 08 17:24:54.491386 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.491241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4nxl\" (UniqueName: \"kubernetes.io/projected/2c1638e5-8aea-466f-bcde-9d1eb540dddd-kube-api-access-k4nxl\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxfq6\" (UID: \"2c1638e5-8aea-466f-bcde-9d1eb540dddd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" Jul 08 17:24:54.591587 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.591549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c1638e5-8aea-466f-bcde-9d1eb540dddd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxfq6\" (UID: \"2c1638e5-8aea-466f-bcde-9d1eb540dddd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" Jul 08 17:24:54.591764 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.591610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4nxl\" (UniqueName: \"kubernetes.io/projected/2c1638e5-8aea-466f-bcde-9d1eb540dddd-kube-api-access-k4nxl\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxfq6\" (UID: \"2c1638e5-8aea-466f-bcde-9d1eb540dddd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" Jul 08 17:24:54.591972 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.591954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c1638e5-8aea-466f-bcde-9d1eb540dddd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxfq6\" (UID: \"2c1638e5-8aea-466f-bcde-9d1eb540dddd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" Jul 08 17:24:54.602743 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.602715 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4nxl\" (UniqueName: \"kubernetes.io/projected/2c1638e5-8aea-466f-bcde-9d1eb540dddd-kube-api-access-k4nxl\") pod \"cert-manager-operator-controller-manager-55c444bf86-pxfq6\" (UID: \"2c1638e5-8aea-466f-bcde-9d1eb540dddd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" Jul 08 17:24:54.685015 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.684977 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" Jul 08 17:24:54.817262 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:54.817230 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6"] Jul 08 17:24:54.820651 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:24:54.820623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1638e5_8aea_466f_bcde_9d1eb540dddd.slice/crio-c860931b92e2a5a8c4e5dea623b3ebf0c7f4975ca82befcca5ce7f2a1addfb4a WatchSource:0}: Error finding container c860931b92e2a5a8c4e5dea623b3ebf0c7f4975ca82befcca5ce7f2a1addfb4a: Status 404 returned error can't find the container with id c860931b92e2a5a8c4e5dea623b3ebf0c7f4975ca82befcca5ce7f2a1addfb4a Jul 08 17:24:55.444711 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:55.444672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" event={"ID":"2c1638e5-8aea-466f-bcde-9d1eb540dddd","Type":"ContainerStarted","Data":"c860931b92e2a5a8c4e5dea623b3ebf0c7f4975ca82befcca5ce7f2a1addfb4a"} Jul 08 17:24:56.018801 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:56.018765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:56.074560 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:56.074520 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:56.450509 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:56.450473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" event={"ID":"2c1638e5-8aea-466f-bcde-9d1eb540dddd","Type":"ContainerStarted","Data":"027927fc756f83aad6999fceea5763bded56072a2e33103f88b90252accda98c"} Jul 08 17:24:56.474642 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:56.474595 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pxfq6" podStartSLOduration=1.011454393 podStartE2EDuration="2.474579721s" totalImagesPullingTime="1.463125328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:24:56.473064387 +0000 UTC m=+346.932276922" watchObservedRunningTime="2026-07-08 17:24:56.474579721 +0000 UTC m=+346.933792253" Jul 08 17:24:56.862627 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:56.862556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:56.993366 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:56.993313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:57.852514 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.852481 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst"] Jul 08 17:24:57.855961 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.855943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:57.858413 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.858389 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 17:24:57.858526 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.858435 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 17:24:57.859368 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.859351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vnltw\"" Jul 08 17:24:57.864778 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.864757 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst"] Jul 08 17:24:57.919625 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.919591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:57.919812 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.919647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:57.919812 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:57.919675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tmjz\" (UniqueName: \"kubernetes.io/projected/4826ea35-4110-4296-bcda-ddfe6730c480-kube-api-access-2tmjz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:58.020222 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.020190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:58.020363 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.020236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:58.020363 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.020263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tmjz\" (UniqueName: \"kubernetes.io/projected/4826ea35-4110-4296-bcda-ddfe6730c480-kube-api-access-2tmjz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:58.020597 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.020576 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:58.020666 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.020638 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:58.028583 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.028555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tmjz\" (UniqueName: \"kubernetes.io/projected/4826ea35-4110-4296-bcda-ddfe6730c480-kube-api-access-2tmjz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:58.165337 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.165310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:24:58.308717 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.308692 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst"] Jul 08 17:24:58.311230 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:24:58.311200 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4826ea35_4110_4296_bcda_ddfe6730c480.slice/crio-48e078a4bcd5814703aefcaa8fe6e83551d8dcbae2b66396c5c69c3692a08b82 WatchSource:0}: Error finding container 48e078a4bcd5814703aefcaa8fe6e83551d8dcbae2b66396c5c69c3692a08b82: Status 404 returned error can't find the container with id 48e078a4bcd5814703aefcaa8fe6e83551d8dcbae2b66396c5c69c3692a08b82 Jul 08 17:24:58.337371 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.337339 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:58.435372 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.435344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:24:58.459901 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.459873 2578 generic.go:356] "Generic (PLEG): container finished" podID="4826ea35-4110-4296-bcda-ddfe6730c480" containerID="24eb3c409ce6fe066ec53b7270fb6a8e5549d5d4143f66cada857c893753b7c8" exitCode=0 Jul 08 17:24:58.460037 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.459943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" event={"ID":"4826ea35-4110-4296-bcda-ddfe6730c480","Type":"ContainerDied","Data":"24eb3c409ce6fe066ec53b7270fb6a8e5549d5d4143f66cada857c893753b7c8"} Jul 08 17:24:58.460037 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:24:58.460031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" event={"ID":"4826ea35-4110-4296-bcda-ddfe6730c480","Type":"ContainerStarted","Data":"48e078a4bcd5814703aefcaa8fe6e83551d8dcbae2b66396c5c69c3692a08b82"} Jul 08 17:25:00.540912 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:00.540880 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:00.738933 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:00.738893 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:01.473309 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:01.473275 2578 generic.go:356] "Generic (PLEG): container finished" podID="4826ea35-4110-4296-bcda-ddfe6730c480" containerID="cd5b8bac2b0ff115c3238ab12eb3329224c5188f3d97d9a2310bde6ffec6eef3" exitCode=0 Jul 08 17:25:01.473491 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:01.473340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" event={"ID":"4826ea35-4110-4296-bcda-ddfe6730c480","Type":"ContainerDied","Data":"cd5b8bac2b0ff115c3238ab12eb3329224c5188f3d97d9a2310bde6ffec6eef3"} Jul 08 17:25:02.479429 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:02.479344 2578 generic.go:356] "Generic (PLEG): container finished" podID="4826ea35-4110-4296-bcda-ddfe6730c480" containerID="f6280af7019253c893f6b10ee6bf09c1d0619345bb620b9788045bf4c6357fd5" exitCode=0 Jul 08 17:25:02.479832 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:02.479434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" event={"ID":"4826ea35-4110-4296-bcda-ddfe6730c480","Type":"ContainerDied","Data":"f6280af7019253c893f6b10ee6bf09c1d0619345bb620b9788045bf4c6357fd5"} Jul 08 17:25:02.817558 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:02.817466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:02.897576 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:02.897533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:03.608158 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.608134 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:25:03.771796 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.771702 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tmjz\" (UniqueName: \"kubernetes.io/projected/4826ea35-4110-4296-bcda-ddfe6730c480-kube-api-access-2tmjz\") pod \"4826ea35-4110-4296-bcda-ddfe6730c480\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " Jul 08 17:25:03.771796 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.771798 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-util\") pod \"4826ea35-4110-4296-bcda-ddfe6730c480\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " Jul 08 17:25:03.772045 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.771914 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-bundle\") pod \"4826ea35-4110-4296-bcda-ddfe6730c480\" (UID: \"4826ea35-4110-4296-bcda-ddfe6730c480\") " Jul 08 17:25:03.778169 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.772770 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-bundle" (OuterVolumeSpecName: "bundle") pod "4826ea35-4110-4296-bcda-ddfe6730c480" (UID: "4826ea35-4110-4296-bcda-ddfe6730c480"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:25:03.778169 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.778123 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-util" (OuterVolumeSpecName: "util") pod "4826ea35-4110-4296-bcda-ddfe6730c480" (UID: "4826ea35-4110-4296-bcda-ddfe6730c480"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:25:03.778351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.778295 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4826ea35-4110-4296-bcda-ddfe6730c480-kube-api-access-2tmjz" (OuterVolumeSpecName: "kube-api-access-2tmjz") pod "4826ea35-4110-4296-bcda-ddfe6730c480" (UID: "4826ea35-4110-4296-bcda-ddfe6730c480"). InnerVolumeSpecName "kube-api-access-2tmjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:25:03.873139 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.873101 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-util\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:25:03.873139 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.873132 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4826ea35-4110-4296-bcda-ddfe6730c480-bundle\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:25:03.873139 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:03.873142 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tmjz\" (UniqueName: \"kubernetes.io/projected/4826ea35-4110-4296-bcda-ddfe6730c480-kube-api-access-2tmjz\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:25:04.489352 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:04.489315 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" event={"ID":"4826ea35-4110-4296-bcda-ddfe6730c480","Type":"ContainerDied","Data":"48e078a4bcd5814703aefcaa8fe6e83551d8dcbae2b66396c5c69c3692a08b82"} Jul 08 17:25:04.489520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:04.489357 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhtvst" Jul 08 17:25:04.489520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:04.489367 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48e078a4bcd5814703aefcaa8fe6e83551d8dcbae2b66396c5c69c3692a08b82" Jul 08 17:25:05.057704 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.057673 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jml9l"] Jul 08 17:25:05.058092 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.057960 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4826ea35-4110-4296-bcda-ddfe6730c480" containerName="pull" Jul 08 17:25:05.058092 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.057971 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4826ea35-4110-4296-bcda-ddfe6730c480" containerName="pull" Jul 08 17:25:05.058092 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.057984 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4826ea35-4110-4296-bcda-ddfe6730c480" containerName="extract" Jul 08 17:25:05.058092 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.057990 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4826ea35-4110-4296-bcda-ddfe6730c480" containerName="extract" Jul 08 17:25:05.058092 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.058008 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4826ea35-4110-4296-bcda-ddfe6730c480" containerName="util" Jul 08 17:25:05.058092 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.058014 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4826ea35-4110-4296-bcda-ddfe6730c480" containerName="util" Jul 08 17:25:05.058092 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.058060 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4826ea35-4110-4296-bcda-ddfe6730c480" containerName="extract" Jul 08 17:25:05.061582 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.061562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:05.065417 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.065385 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 17:25:05.065526 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.065431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hhmw9\"" Jul 08 17:25:05.065526 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.065395 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 17:25:05.073896 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.073872 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jml9l"] Jul 08 17:25:05.182510 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.182467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrthm\" (UniqueName: \"kubernetes.io/projected/aad50db0-e59c-4ce5-b348-318d0e44bd0f-kube-api-access-xrthm\") pod \"cert-manager-webhook-6486ffd997-jml9l\" (UID: \"aad50db0-e59c-4ce5-b348-318d0e44bd0f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:05.182703 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.182537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aad50db0-e59c-4ce5-b348-318d0e44bd0f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jml9l\" (UID: \"aad50db0-e59c-4ce5-b348-318d0e44bd0f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:05.284001 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.283970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrthm\" (UniqueName: \"kubernetes.io/projected/aad50db0-e59c-4ce5-b348-318d0e44bd0f-kube-api-access-xrthm\") pod \"cert-manager-webhook-6486ffd997-jml9l\" (UID: \"aad50db0-e59c-4ce5-b348-318d0e44bd0f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:05.284203 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.284026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aad50db0-e59c-4ce5-b348-318d0e44bd0f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jml9l\" (UID: \"aad50db0-e59c-4ce5-b348-318d0e44bd0f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:05.297476 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.297443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrthm\" (UniqueName: \"kubernetes.io/projected/aad50db0-e59c-4ce5-b348-318d0e44bd0f-kube-api-access-xrthm\") pod \"cert-manager-webhook-6486ffd997-jml9l\" (UID: \"aad50db0-e59c-4ce5-b348-318d0e44bd0f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:05.301359 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.301331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aad50db0-e59c-4ce5-b348-318d0e44bd0f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jml9l\" (UID: \"aad50db0-e59c-4ce5-b348-318d0e44bd0f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:05.382594 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.382512 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:05.510642 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:05.510618 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jml9l"] Jul 08 17:25:05.513422 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:25:05.513396 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaad50db0_e59c_4ce5_b348_318d0e44bd0f.slice/crio-2237b532790ca50aa57b0a4f52575212b7c4e88e9dac222c2a03e3b91480eb4e WatchSource:0}: Error finding container 2237b532790ca50aa57b0a4f52575212b7c4e88e9dac222c2a03e3b91480eb4e: Status 404 returned error can't find the container with id 2237b532790ca50aa57b0a4f52575212b7c4e88e9dac222c2a03e3b91480eb4e Jul 08 17:25:06.500297 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:06.500261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" event={"ID":"aad50db0-e59c-4ce5-b348-318d0e44bd0f","Type":"ContainerStarted","Data":"2237b532790ca50aa57b0a4f52575212b7c4e88e9dac222c2a03e3b91480eb4e"} Jul 08 17:25:08.510803 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:08.510768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" event={"ID":"aad50db0-e59c-4ce5-b348-318d0e44bd0f","Type":"ContainerStarted","Data":"3b55135011df8340c83b06d5a11f2ee9f3e2a4d93b66e291d98ac74908a1b5f2"} Jul 08 17:25:08.511195 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:08.510902 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:08.537068 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:08.537016 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" podStartSLOduration=0.748487916 podStartE2EDuration="3.537000716s" totalImagesPullingTime="2.7885128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:25:08.534756476 +0000 UTC m=+358.993969008" watchObservedRunningTime="2026-07-08 17:25:08.537000716 +0000 UTC m=+358.996213249" Jul 08 17:25:08.561650 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:08.561565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:08.620479 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:08.620444 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:08.758150 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:08.758115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:08.862349 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:08.862259 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:08.967512 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:08.967481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:14.517740 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:14.517705 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jml9l" Jul 08 17:25:14.966400 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:14.966362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:15.065768 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:15.065732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:17.502806 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:17.502773 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:18.886491 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:18.886454 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-djwng"] Jul 08 17:25:18.904644 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:18.904565 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-djwng"] Jul 08 17:25:18.904912 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:18.904661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-djwng" Jul 08 17:25:18.907065 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:18.907043 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kzqvt\"" Jul 08 17:25:18.983673 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:18.983621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bee69dd6-b658-4415-af28-eb5f44059bdb-bound-sa-token\") pod \"cert-manager-55b4d954d5-djwng\" (UID: \"bee69dd6-b658-4415-af28-eb5f44059bdb\") " pod="cert-manager/cert-manager-55b4d954d5-djwng" Jul 08 17:25:18.983673 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:18.983669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npvt7\" (UniqueName: \"kubernetes.io/projected/bee69dd6-b658-4415-af28-eb5f44059bdb-kube-api-access-npvt7\") pod \"cert-manager-55b4d954d5-djwng\" (UID: \"bee69dd6-b658-4415-af28-eb5f44059bdb\") " pod="cert-manager/cert-manager-55b4d954d5-djwng" Jul 08 17:25:19.085080 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.085042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bee69dd6-b658-4415-af28-eb5f44059bdb-bound-sa-token\") pod \"cert-manager-55b4d954d5-djwng\" (UID: \"bee69dd6-b658-4415-af28-eb5f44059bdb\") " pod="cert-manager/cert-manager-55b4d954d5-djwng" Jul 08 17:25:19.085080 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.085084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npvt7\" (UniqueName: \"kubernetes.io/projected/bee69dd6-b658-4415-af28-eb5f44059bdb-kube-api-access-npvt7\") pod \"cert-manager-55b4d954d5-djwng\" (UID: \"bee69dd6-b658-4415-af28-eb5f44059bdb\") " pod="cert-manager/cert-manager-55b4d954d5-djwng" Jul 08 17:25:19.093055 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.093024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bee69dd6-b658-4415-af28-eb5f44059bdb-bound-sa-token\") pod \"cert-manager-55b4d954d5-djwng\" (UID: \"bee69dd6-b658-4415-af28-eb5f44059bdb\") " pod="cert-manager/cert-manager-55b4d954d5-djwng" Jul 08 17:25:19.093213 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.093192 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npvt7\" (UniqueName: \"kubernetes.io/projected/bee69dd6-b658-4415-af28-eb5f44059bdb-kube-api-access-npvt7\") pod \"cert-manager-55b4d954d5-djwng\" (UID: \"bee69dd6-b658-4415-af28-eb5f44059bdb\") " pod="cert-manager/cert-manager-55b4d954d5-djwng" Jul 08 17:25:19.215313 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.215224 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-djwng" Jul 08 17:25:19.361585 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.361553 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-djwng"] Jul 08 17:25:19.365339 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:25:19.365312 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbee69dd6_b658_4415_af28_eb5f44059bdb.slice/crio-a5081b52328baf14230c603ac098ec50d319ba81b80fb6b2a10ef42fa3426551 WatchSource:0}: Error finding container a5081b52328baf14230c603ac098ec50d319ba81b80fb6b2a10ef42fa3426551: Status 404 returned error can't find the container with id a5081b52328baf14230c603ac098ec50d319ba81b80fb6b2a10ef42fa3426551 Jul 08 17:25:19.562933 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.562832 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-djwng" event={"ID":"bee69dd6-b658-4415-af28-eb5f44059bdb","Type":"ContainerStarted","Data":"c44a6b50c896e9e94508190053bef34cbb0e743eaaae03663036ff2ff575b27a"} Jul 08 17:25:19.562933 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.562891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-djwng" event={"ID":"bee69dd6-b658-4415-af28-eb5f44059bdb","Type":"ContainerStarted","Data":"a5081b52328baf14230c603ac098ec50d319ba81b80fb6b2a10ef42fa3426551"} Jul 08 17:25:19.580326 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.580276 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-djwng" podStartSLOduration=1.58025908 podStartE2EDuration="1.58025908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:25:19.578618472 +0000 UTC m=+370.037831004" watchObservedRunningTime="2026-07-08 17:25:19.58025908 +0000 UTC m=+370.039471611" Jul 08 17:25:19.904911 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.904872 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f"] Jul 08 17:25:19.925167 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.925140 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f"] Jul 08 17:25:19.925306 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.925252 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:19.927968 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.927940 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 17:25:19.928118 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.928016 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vnltw\"" Jul 08 17:25:19.928118 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.928037 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 17:25:19.990450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.990419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:19.990450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.990456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8gf\" (UniqueName: \"kubernetes.io/projected/2d61a904-d6bd-4aea-9864-0faf87eb793a-kube-api-access-6l8gf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:19.990658 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:19.990499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:20.091545 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.091508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:20.091545 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.091547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8gf\" (UniqueName: \"kubernetes.io/projected/2d61a904-d6bd-4aea-9864-0faf87eb793a-kube-api-access-6l8gf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:20.091841 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.091671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:20.091983 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.091957 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:20.091983 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.091978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:20.100034 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.100011 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8gf\" (UniqueName: \"kubernetes.io/projected/2d61a904-d6bd-4aea-9864-0faf87eb793a-kube-api-access-6l8gf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:20.234608 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.234529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:20.382044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.382019 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f"] Jul 08 17:25:20.384152 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:25:20.384125 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d61a904_d6bd_4aea_9864_0faf87eb793a.slice/crio-c2bde3a2bf2c4c078832f2afd5c18257a595aab0b64b167bc56518c4645e215a WatchSource:0}: Error finding container c2bde3a2bf2c4c078832f2afd5c18257a595aab0b64b167bc56518c4645e215a: Status 404 returned error can't find the container with id c2bde3a2bf2c4c078832f2afd5c18257a595aab0b64b167bc56518c4645e215a Jul 08 17:25:20.568500 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.568464 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" event={"ID":"2d61a904-d6bd-4aea-9864-0faf87eb793a","Type":"ContainerStarted","Data":"c16788821f5e6a299b8fe8cd759069e244d753ffc916f7bc90978b9e305e09c5"} Jul 08 17:25:20.568631 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:20.568546 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" event={"ID":"2d61a904-d6bd-4aea-9864-0faf87eb793a","Type":"ContainerStarted","Data":"c2bde3a2bf2c4c078832f2afd5c18257a595aab0b64b167bc56518c4645e215a"} Jul 08 17:25:21.573986 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:21.573955 2578 generic.go:356] "Generic (PLEG): container finished" podID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerID="c16788821f5e6a299b8fe8cd759069e244d753ffc916f7bc90978b9e305e09c5" exitCode=0 Jul 08 17:25:21.574370 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:21.574008 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" event={"ID":"2d61a904-d6bd-4aea-9864-0faf87eb793a","Type":"ContainerDied","Data":"c16788821f5e6a299b8fe8cd759069e244d753ffc916f7bc90978b9e305e09c5"} Jul 08 17:25:22.579426 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:22.579394 2578 generic.go:356] "Generic (PLEG): container finished" podID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerID="2a19afa37587c04a591b2f1f29cdf83585c683d6f03426730d8ba14b512fc5ca" exitCode=0 Jul 08 17:25:22.579847 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:22.579480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" event={"ID":"2d61a904-d6bd-4aea-9864-0faf87eb793a","Type":"ContainerDied","Data":"2a19afa37587c04a591b2f1f29cdf83585c683d6f03426730d8ba14b512fc5ca"} Jul 08 17:25:23.585753 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:23.585716 2578 generic.go:356] "Generic (PLEG): container finished" podID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerID="9fcc5b48b51fbd257e9e6dc8c18d8e36401163871704ff4db02ff9ccc54fc49a" exitCode=0 Jul 08 17:25:23.585753 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:23.585756 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" event={"ID":"2d61a904-d6bd-4aea-9864-0faf87eb793a","Type":"ContainerDied","Data":"9fcc5b48b51fbd257e9e6dc8c18d8e36401163871704ff4db02ff9ccc54fc49a"} Jul 08 17:25:24.725473 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.725450 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:24.822847 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.822816 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-bundle\") pod \"2d61a904-d6bd-4aea-9864-0faf87eb793a\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " Jul 08 17:25:24.822847 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.822862 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l8gf\" (UniqueName: \"kubernetes.io/projected/2d61a904-d6bd-4aea-9864-0faf87eb793a-kube-api-access-6l8gf\") pod \"2d61a904-d6bd-4aea-9864-0faf87eb793a\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " Jul 08 17:25:24.823073 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.822897 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-util\") pod \"2d61a904-d6bd-4aea-9864-0faf87eb793a\" (UID: \"2d61a904-d6bd-4aea-9864-0faf87eb793a\") " Jul 08 17:25:24.823528 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.823497 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-bundle" (OuterVolumeSpecName: "bundle") pod "2d61a904-d6bd-4aea-9864-0faf87eb793a" (UID: "2d61a904-d6bd-4aea-9864-0faf87eb793a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:25:24.824892 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.824840 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d61a904-d6bd-4aea-9864-0faf87eb793a-kube-api-access-6l8gf" (OuterVolumeSpecName: "kube-api-access-6l8gf") pod "2d61a904-d6bd-4aea-9864-0faf87eb793a" (UID: "2d61a904-d6bd-4aea-9864-0faf87eb793a"). InnerVolumeSpecName "kube-api-access-6l8gf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:25:24.828345 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.828327 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-util" (OuterVolumeSpecName: "util") pod "2d61a904-d6bd-4aea-9864-0faf87eb793a" (UID: "2d61a904-d6bd-4aea-9864-0faf87eb793a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:25:24.923984 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.923951 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-util\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:25:24.923984 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.923978 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d61a904-d6bd-4aea-9864-0faf87eb793a-bundle\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:25:24.923984 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:24.923987 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l8gf\" (UniqueName: \"kubernetes.io/projected/2d61a904-d6bd-4aea-9864-0faf87eb793a-kube-api-access-6l8gf\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:25:25.596524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:25.596488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" event={"ID":"2d61a904-d6bd-4aea-9864-0faf87eb793a","Type":"ContainerDied","Data":"c2bde3a2bf2c4c078832f2afd5c18257a595aab0b64b167bc56518c4645e215a"} Jul 08 17:25:25.596524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:25.596523 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7hg8f" Jul 08 17:25:25.596732 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:25.596536 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2bde3a2bf2c4c078832f2afd5c18257a595aab0b64b167bc56518c4645e215a" Jul 08 17:25:34.936611 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:34.936569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:35.059364 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:35.059325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:35.612231 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:35.612191 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:35.960904 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:35.960869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:36.069148 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.069103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:36.096438 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.096410 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs"] Jul 08 17:25:36.096692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.096679 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerName="extract" Jul 08 17:25:36.096738 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.096696 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerName="extract" Jul 08 17:25:36.096738 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.096728 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerName="pull" Jul 08 17:25:36.096738 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.096737 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerName="pull" Jul 08 17:25:36.096831 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.096758 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerName="util" Jul 08 17:25:36.096831 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.096767 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerName="util" Jul 08 17:25:36.096909 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.096840 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d61a904-d6bd-4aea-9864-0faf87eb793a" containerName="extract" Jul 08 17:25:36.100138 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.100113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.102895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.102873 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 17:25:36.103153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.103136 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 17:25:36.103238 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.103222 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5mnw4\"" Jul 08 17:25:36.103307 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.103287 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 17:25:36.103623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.103610 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 17:25:36.116339 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.116317 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs"] Jul 08 17:25:36.205745 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.205707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtdz\" (UniqueName: \"kubernetes.io/projected/d9a6786f-6d20-4238-a56d-8ca36338f07a-kube-api-access-2vtdz\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.205949 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.205760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9a6786f-6d20-4238-a56d-8ca36338f07a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.205949 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.205783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9a6786f-6d20-4238-a56d-8ca36338f07a-webhook-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.205949 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.205873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9a6786f-6d20-4238-a56d-8ca36338f07a-tmp\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.205949 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.205908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9a6786f-6d20-4238-a56d-8ca36338f07a-manifests\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.240219 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.240133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:36.306366 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.306332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtdz\" (UniqueName: \"kubernetes.io/projected/d9a6786f-6d20-4238-a56d-8ca36338f07a-kube-api-access-2vtdz\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.306524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.306378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9a6786f-6d20-4238-a56d-8ca36338f07a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.306524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.306402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9a6786f-6d20-4238-a56d-8ca36338f07a-webhook-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.306524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.306430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9a6786f-6d20-4238-a56d-8ca36338f07a-tmp\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.306524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.306449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9a6786f-6d20-4238-a56d-8ca36338f07a-manifests\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.306830 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.306812 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9a6786f-6d20-4238-a56d-8ca36338f07a-manifests\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.308917 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.308890 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9a6786f-6d20-4238-a56d-8ca36338f07a-tmp\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.309010 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.308979 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9a6786f-6d20-4238-a56d-8ca36338f07a-webhook-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.309049 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.309024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9a6786f-6d20-4238-a56d-8ca36338f07a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.314963 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.314939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtdz\" (UniqueName: \"kubernetes.io/projected/d9a6786f-6d20-4238-a56d-8ca36338f07a-kube-api-access-2vtdz\") pod \"opendatahub-operator-controller-manager-574956cb5f-jhpjs\" (UID: \"d9a6786f-6d20-4238-a56d-8ca36338f07a\") " pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.340576 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.340543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:36.409954 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.409921 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:36.442119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.442092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:36.565193 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.565000 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs"] Jul 08 17:25:36.568065 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:25:36.568036 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a6786f_6d20_4238_a56d_8ca36338f07a.slice/crio-b170655351c0d5a3749a13f151e8e790073e9bd85d215fa6291fecd851546de5 WatchSource:0}: Error finding container b170655351c0d5a3749a13f151e8e790073e9bd85d215fa6291fecd851546de5: Status 404 returned error can't find the container with id b170655351c0d5a3749a13f151e8e790073e9bd85d215fa6291fecd851546de5 Jul 08 17:25:36.568923 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.568892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:36.643252 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.643220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" event={"ID":"d9a6786f-6d20-4238-a56d-8ca36338f07a","Type":"ContainerStarted","Data":"b170655351c0d5a3749a13f151e8e790073e9bd85d215fa6291fecd851546de5"} Jul 08 17:25:36.665993 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.665957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:36.766281 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:36.766245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:40.663130 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:40.663096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" event={"ID":"d9a6786f-6d20-4238-a56d-8ca36338f07a","Type":"ContainerStarted","Data":"6b32fd3e6a1e4d61cd5b9c24d2c409cc0c892f2a4c734d401f705890962c9f79"} Jul 08 17:25:41.668840 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:41.668807 2578 generic.go:356] "Generic (PLEG): container finished" podID="d9a6786f-6d20-4238-a56d-8ca36338f07a" containerID="6b32fd3e6a1e4d61cd5b9c24d2c409cc0c892f2a4c734d401f705890962c9f79" exitCode=0 Jul 08 17:25:41.669230 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:41.668887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" event={"ID":"d9a6786f-6d20-4238-a56d-8ca36338f07a","Type":"ContainerDied","Data":"6b32fd3e6a1e4d61cd5b9c24d2c409cc0c892f2a4c734d401f705890962c9f79"} Jul 08 17:25:42.675390 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:42.675362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" event={"ID":"d9a6786f-6d20-4238-a56d-8ca36338f07a","Type":"ContainerStarted","Data":"909dee255168b4e58081dc85b237ab99fd712fee4ddeda97984481804f697cc4"} Jul 08 17:25:42.675778 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:42.675475 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:42.699740 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:42.699697 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" podStartSLOduration=1.477412439 podStartE2EDuration="6.699682835s" totalImagesPullingTime="4.145037128s" totalInitContainerRuntime="1.077233268s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:25:42.697331789 +0000 UTC m=+393.156544321" watchObservedRunningTime="2026-07-08 17:25:42.699682835 +0000 UTC m=+393.158895436" Jul 08 17:25:46.330832 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:46.330797 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:48.178638 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:48.178603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:48.237532 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:48.237505 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:48.659241 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:48.659206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:48.779153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:48.779066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:53.085481 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:53.085450 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:53.143416 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:53.143377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:53.525584 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:53.525535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:53.624242 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:53.624209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:53.682365 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:53.682340 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-574956cb5f-jhpjs" Jul 08 17:25:55.584405 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:55.584369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:55.706290 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:55.706246 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:56.352263 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.352232 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wktpf"] Jul 08 17:25:56.360340 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.360318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:25:56.363204 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.363183 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 08 17:25:56.363333 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.363309 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cjhq8\"" Jul 08 17:25:56.371643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.371622 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wktpf"] Jul 08 17:25:56.412029 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.411997 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:56.469295 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.469257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzfr2\" (UniqueName: \"kubernetes.io/projected/b7f82876-01bf-4978-8cef-10edd34e57d2-kube-api-access-tzfr2\") pod \"odh-model-controller-7998c67dc4-wktpf\" (UID: \"b7f82876-01bf-4978-8cef-10edd34e57d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:25:56.469452 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.469315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7f82876-01bf-4978-8cef-10edd34e57d2-cert\") pod \"odh-model-controller-7998c67dc4-wktpf\" (UID: \"b7f82876-01bf-4978-8cef-10edd34e57d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:25:56.516991 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.516956 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:56.570245 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.570209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzfr2\" (UniqueName: \"kubernetes.io/projected/b7f82876-01bf-4978-8cef-10edd34e57d2-kube-api-access-tzfr2\") pod \"odh-model-controller-7998c67dc4-wktpf\" (UID: \"b7f82876-01bf-4978-8cef-10edd34e57d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:25:56.570453 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.570282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7f82876-01bf-4978-8cef-10edd34e57d2-cert\") pod \"odh-model-controller-7998c67dc4-wktpf\" (UID: \"b7f82876-01bf-4978-8cef-10edd34e57d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:25:56.572793 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.572764 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7f82876-01bf-4978-8cef-10edd34e57d2-cert\") pod \"odh-model-controller-7998c67dc4-wktpf\" (UID: \"b7f82876-01bf-4978-8cef-10edd34e57d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:25:56.578693 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.578661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzfr2\" (UniqueName: \"kubernetes.io/projected/b7f82876-01bf-4978-8cef-10edd34e57d2-kube-api-access-tzfr2\") pod \"odh-model-controller-7998c67dc4-wktpf\" (UID: \"b7f82876-01bf-4978-8cef-10edd34e57d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:25:56.614194 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.614107 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:56.670203 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.670168 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:25:56.801307 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.801257 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wktpf"] Jul 08 17:25:56.803921 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:25:56.803893 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f82876_01bf_4978_8cef_10edd34e57d2.slice/crio-63b8d0fae9a83581b9ccecf0a21ad97acfbc30b8c8321925f571b07fbb5dc4b4 WatchSource:0}: Error finding container 63b8d0fae9a83581b9ccecf0a21ad97acfbc30b8c8321925f571b07fbb5dc4b4: Status 404 returned error can't find the container with id 63b8d0fae9a83581b9ccecf0a21ad97acfbc30b8c8321925f571b07fbb5dc4b4 Jul 08 17:25:56.988195 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:56.988161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:57.151694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:57.151656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:25:57.744213 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:57.744160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" event={"ID":"b7f82876-01bf-4978-8cef-10edd34e57d2","Type":"ContainerStarted","Data":"63b8d0fae9a83581b9ccecf0a21ad97acfbc30b8c8321925f571b07fbb5dc4b4"} Jul 08 17:25:58.180105 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:25:58.180073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:00.761696 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:00.761653 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" event={"ID":"b7f82876-01bf-4978-8cef-10edd34e57d2","Type":"ContainerStarted","Data":"ee07aeb1d6fdaca3f2f1fd75f5118d86edd4c5fc71ee530c015fc30d2190cdef"} Jul 08 17:26:00.762145 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:00.761781 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:26:00.777957 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:00.777918 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" podStartSLOduration=1.3406693459999999 podStartE2EDuration="4.77790572s" totalImagesPullingTime="3.437236374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:00.777144185 +0000 UTC m=+411.236356717" watchObservedRunningTime="2026-07-08 17:26:00.77790572 +0000 UTC m=+411.237118304" Jul 08 17:26:03.581258 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.581222 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25"] Jul 08 17:26:03.584447 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.584428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.588648 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.588622 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 17:26:03.588648 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.588636 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mn2gr\"" Jul 08 17:26:03.588832 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.588637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 17:26:03.588832 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.588624 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 17:26:03.589002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.588986 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 17:26:03.589074 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.589008 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:26:03.597141 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.597109 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25"] Jul 08 17:26:03.735203 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.735166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1ec1cba-2302-4c56-be51-30ebe8821d27-metrics-cert\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.735388 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.735240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1ec1cba-2302-4c56-be51-30ebe8821d27-manager-config\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.735388 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.735307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ec1cba-2302-4c56-be51-30ebe8821d27-cert\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.735388 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.735351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-927w7\" (UniqueName: \"kubernetes.io/projected/e1ec1cba-2302-4c56-be51-30ebe8821d27-kube-api-access-927w7\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.836367 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.836266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1ec1cba-2302-4c56-be51-30ebe8821d27-metrics-cert\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.836367 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.836358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1ec1cba-2302-4c56-be51-30ebe8821d27-manager-config\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.836619 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.836390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ec1cba-2302-4c56-be51-30ebe8821d27-cert\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.836619 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.836418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-927w7\" (UniqueName: \"kubernetes.io/projected/e1ec1cba-2302-4c56-be51-30ebe8821d27-kube-api-access-927w7\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.837089 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.837063 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1ec1cba-2302-4c56-be51-30ebe8821d27-manager-config\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.839029 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.839003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ec1cba-2302-4c56-be51-30ebe8821d27-cert\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.839128 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.839049 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1ec1cba-2302-4c56-be51-30ebe8821d27-metrics-cert\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.848337 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.848313 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-927w7\" (UniqueName: \"kubernetes.io/projected/e1ec1cba-2302-4c56-be51-30ebe8821d27-kube-api-access-927w7\") pod \"lws-controller-manager-7b689d6b77-b8l25\" (UID: \"e1ec1cba-2302-4c56-be51-30ebe8821d27\") " pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:03.894094 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:03.894059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:04.037443 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:04.037417 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25"] Jul 08 17:26:04.039745 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:26:04.039720 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ec1cba_2302_4c56_be51_30ebe8821d27.slice/crio-d06d44d3fa4aac11843f68758ea6a522d70985b29db4a9fc62640d778b6edbe6 WatchSource:0}: Error finding container d06d44d3fa4aac11843f68758ea6a522d70985b29db4a9fc62640d778b6edbe6: Status 404 returned error can't find the container with id d06d44d3fa4aac11843f68758ea6a522d70985b29db4a9fc62640d778b6edbe6 Jul 08 17:26:04.780526 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:04.780480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" event={"ID":"e1ec1cba-2302-4c56-be51-30ebe8821d27","Type":"ContainerStarted","Data":"d06d44d3fa4aac11843f68758ea6a522d70985b29db4a9fc62640d778b6edbe6"} Jul 08 17:26:05.787191 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:05.787155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" event={"ID":"e1ec1cba-2302-4c56-be51-30ebe8821d27","Type":"ContainerStarted","Data":"bb05d4b75fab763b378b8bd3c55ce3f41b21279781c4292b2f237ce87598f7b5"} Jul 08 17:26:05.787590 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:05.787290 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:05.820019 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:05.819962 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" podStartSLOduration=1.586679609 podStartE2EDuration="2.819942087s" totalImagesPullingTime="1.233262478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:05.817558178 +0000 UTC m=+416.276770710" watchObservedRunningTime="2026-07-08 17:26:05.819942087 +0000 UTC m=+416.279154618" Jul 08 17:26:06.080106 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:06.080000 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:06.240830 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:06.240789 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:06.444259 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:06.444222 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:06.697368 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:06.697256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:06.980081 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:06.979987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:07.415494 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:07.415448 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:07.606265 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:07.606227 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:07.694500 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:07.694416 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:08.842041 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:08.842004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:08.935909 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:08.935843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:09.942496 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:09.942458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:11.768512 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:11.768481 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wktpf" Jul 08 17:26:12.106751 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:12.106660 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:14.253761 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:14.253729 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:14.620973 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:14.620882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:14.793152 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:14.793121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:15.247495 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.247463 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz"] Jul 08 17:26:15.258322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.258298 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.261102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.261079 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xbhvr\"" Jul 08 17:26:15.261196 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.261113 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 17:26:15.267841 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.267818 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz"] Jul 08 17:26:15.283452 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.283420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:15.406992 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.406964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:15.442049 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.442244 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.442244 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442104 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d46654-aa3d-4c92-9adf-a8e022855d77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.442244 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.442244 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.442244 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwc9p\" (UniqueName: \"kubernetes.io/projected/20d46654-aa3d-4c92-9adf-a8e022855d77-kube-api-access-mwc9p\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.442244 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.442481 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.442481 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.442330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543236 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543236 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d46654-aa3d-4c92-9adf-a8e022855d77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543236 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543228 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwc9p\" (UniqueName: \"kubernetes.io/projected/20d46654-aa3d-4c92-9adf-a8e022855d77-kube-api-access-mwc9p\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543836 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543836 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543728 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543836 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.543997 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.543922 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.544066 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.544045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d46654-aa3d-4c92-9adf-a8e022855d77-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.546051 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.546027 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.546162 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.546145 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.552002 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.551981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d46654-aa3d-4c92-9adf-a8e022855d77-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.552156 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.552138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwc9p\" (UniqueName: \"kubernetes.io/projected/20d46654-aa3d-4c92-9adf-a8e022855d77-kube-api-access-mwc9p\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l8cqz\" (UID: \"20d46654-aa3d-4c92-9adf-a8e022855d77\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.570093 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.570059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:15.591793 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.591758 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:15.714410 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.714383 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz"] Jul 08 17:26:15.716881 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:26:15.716837 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d46654_aa3d_4c92_9adf_a8e022855d77.slice/crio-5352573de9ed26e28e27ef71a48664edadd48f7629913809cde2e663478966d0 WatchSource:0}: Error finding container 5352573de9ed26e28e27ef71a48664edadd48f7629913809cde2e663478966d0: Status 404 returned error can't find the container with id 5352573de9ed26e28e27ef71a48664edadd48f7629913809cde2e663478966d0 Jul 08 17:26:15.835314 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:15.835229 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" event={"ID":"20d46654-aa3d-4c92-9adf-a8e022855d77","Type":"ContainerStarted","Data":"5352573de9ed26e28e27ef71a48664edadd48f7629913809cde2e663478966d0"} Jul 08 17:26:16.794714 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:16.794685 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b689d6b77-b8l25" Jul 08 17:26:19.078961 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:19.078924 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:26:19.079231 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:19.078998 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:26:19.079231 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:19.079026 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:26:19.855862 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:19.855808 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" event={"ID":"20d46654-aa3d-4c92-9adf-a8e022855d77","Type":"ContainerStarted","Data":"b7d1d10d188c7b5975a74677a04bd8458469e3879c9c4c13938a7deabb0dff2a"} Jul 08 17:26:19.877182 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:19.877129 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" podStartSLOduration=1.51752765 podStartE2EDuration="4.877114544s" totalImagesPullingTime="3.359586894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:19.875265463 +0000 UTC m=+430.334477997" watchObservedRunningTime="2026-07-08 17:26:19.877114544 +0000 UTC m=+430.336327139" Jul 08 17:26:20.570611 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:20.570568 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:20.576035 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:20.576009 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:20.861131 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:20.861035 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:20.861945 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:20.861923 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l8cqz" Jul 08 17:26:52.792891 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:52.792831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:57.077190 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.077156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:57.180899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.180840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:57.206492 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.206462 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hm8r"] Jul 08 17:26:57.214820 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.214790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" Jul 08 17:26:57.217556 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.217532 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hm5j2\"" Jul 08 17:26:57.217697 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.217541 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 17:26:57.218067 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.218040 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hm8r"] Jul 08 17:26:57.218843 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.218592 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 17:26:57.261993 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.261956 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:57.300954 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.297765 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2wxd\" (UniqueName: \"kubernetes.io/projected/f874e465-d322-4f8b-9f79-34c8965398d7-kube-api-access-b2wxd\") pod \"kuadrant-operator-catalog-2hm8r\" (UID: \"f874e465-d322-4f8b-9f79-34c8965398d7\") " pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" Jul 08 17:26:57.398744 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.398706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2wxd\" (UniqueName: \"kubernetes.io/projected/f874e465-d322-4f8b-9f79-34c8965398d7-kube-api-access-b2wxd\") pod \"kuadrant-operator-catalog-2hm8r\" (UID: \"f874e465-d322-4f8b-9f79-34c8965398d7\") " pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" Jul 08 17:26:57.407326 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.407299 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2wxd\" (UniqueName: \"kubernetes.io/projected/f874e465-d322-4f8b-9f79-34c8965398d7-kube-api-access-b2wxd\") pod \"kuadrant-operator-catalog-2hm8r\" (UID: \"f874e465-d322-4f8b-9f79-34c8965398d7\") " pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" Jul 08 17:26:57.526950 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.526909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" Jul 08 17:26:57.577748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.577370 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hm8r"] Jul 08 17:26:57.660956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.660880 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hm8r"] Jul 08 17:26:57.663820 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:26:57.663795 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf874e465_d322_4f8b_9f79_34c8965398d7.slice/crio-3ac13677af037164454f9ec114cd5b60f902691618dfd8f4aad694e3dd984212 WatchSource:0}: Error finding container 3ac13677af037164454f9ec114cd5b60f902691618dfd8f4aad694e3dd984212: Status 404 returned error can't find the container with id 3ac13677af037164454f9ec114cd5b60f902691618dfd8f4aad694e3dd984212 Jul 08 17:26:57.788292 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.788249 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pt2d2"] Jul 08 17:26:57.792977 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.792958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:26:57.799695 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.799663 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pt2d2"] Jul 08 17:26:57.904239 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:57.904199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wklb8\" (UniqueName: \"kubernetes.io/projected/33db8e5e-5930-4b46-bebe-3a898f6537b2-kube-api-access-wklb8\") pod \"kuadrant-operator-catalog-pt2d2\" (UID: \"33db8e5e-5930-4b46-bebe-3a898f6537b2\") " pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:26:58.005505 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:58.005403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wklb8\" (UniqueName: \"kubernetes.io/projected/33db8e5e-5930-4b46-bebe-3a898f6537b2-kube-api-access-wklb8\") pod \"kuadrant-operator-catalog-pt2d2\" (UID: \"33db8e5e-5930-4b46-bebe-3a898f6537b2\") " pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:26:58.009733 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:58.009697 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:58.013945 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:58.013922 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wklb8\" (UniqueName: \"kubernetes.io/projected/33db8e5e-5930-4b46-bebe-3a898f6537b2-kube-api-access-wklb8\") pod \"kuadrant-operator-catalog-pt2d2\" (UID: \"33db8e5e-5930-4b46-bebe-3a898f6537b2\") " pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:26:58.022918 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:58.022893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" event={"ID":"f874e465-d322-4f8b-9f79-34c8965398d7","Type":"ContainerStarted","Data":"3ac13677af037164454f9ec114cd5b60f902691618dfd8f4aad694e3dd984212"} Jul 08 17:26:58.103119 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:58.103088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:26:58.223079 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:58.223047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:26:58.246643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:58.246619 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pt2d2"] Jul 08 17:26:58.248782 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:26:58.248759 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33db8e5e_5930_4b46_bebe_3a898f6537b2.slice/crio-312a0fe1624f175b9979d177393471e85fd6880aeb0e4596407f605100fe7b61 WatchSource:0}: Error finding container 312a0fe1624f175b9979d177393471e85fd6880aeb0e4596407f605100fe7b61: Status 404 returned error can't find the container with id 312a0fe1624f175b9979d177393471e85fd6880aeb0e4596407f605100fe7b61 Jul 08 17:26:59.030563 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:26:59.030530 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" event={"ID":"33db8e5e-5930-4b46-bebe-3a898f6537b2","Type":"ContainerStarted","Data":"312a0fe1624f175b9979d177393471e85fd6880aeb0e4596407f605100fe7b61"} Jul 08 17:27:01.042684 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.042644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" event={"ID":"33db8e5e-5930-4b46-bebe-3a898f6537b2","Type":"ContainerStarted","Data":"032275514ae146fb07e1053dcaa67b9635af8c5a11098b7f17a29e6ef6afba01"} Jul 08 17:27:01.044185 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.044159 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" event={"ID":"f874e465-d322-4f8b-9f79-34c8965398d7","Type":"ContainerStarted","Data":"3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f"} Jul 08 17:27:01.044291 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.044246 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" podUID="f874e465-d322-4f8b-9f79-34c8965398d7" containerName="registry-server" containerID="cri-o://3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f" gracePeriod=2 Jul 08 17:27:01.059158 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.059110 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" podStartSLOduration=2.262052912 podStartE2EDuration="4.059092589s" totalImagesPullingTime="1.797039677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:01.05802559 +0000 UTC m=+471.517238114" watchObservedRunningTime="2026-07-08 17:27:01.059092589 +0000 UTC m=+471.518305121" Jul 08 17:27:01.074105 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.074051 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" podStartSLOduration=1.6950856779999999 podStartE2EDuration="4.074035239s" totalImagesPullingTime="2.378949561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:01.07237877 +0000 UTC m=+471.531591303" watchObservedRunningTime="2026-07-08 17:27:01.074035239 +0000 UTC m=+471.533247771" Jul 08 17:27:01.306073 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.306009 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" Jul 08 17:27:01.436792 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.436760 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2wxd\" (UniqueName: \"kubernetes.io/projected/f874e465-d322-4f8b-9f79-34c8965398d7-kube-api-access-b2wxd\") pod \"f874e465-d322-4f8b-9f79-34c8965398d7\" (UID: \"f874e465-d322-4f8b-9f79-34c8965398d7\") " Jul 08 17:27:01.439019 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.438989 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f874e465-d322-4f8b-9f79-34c8965398d7-kube-api-access-b2wxd" (OuterVolumeSpecName: "kube-api-access-b2wxd") pod "f874e465-d322-4f8b-9f79-34c8965398d7" (UID: "f874e465-d322-4f8b-9f79-34c8965398d7"). InnerVolumeSpecName "kube-api-access-b2wxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:27:01.538305 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:01.538250 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2wxd\" (UniqueName: \"kubernetes.io/projected/f874e465-d322-4f8b-9f79-34c8965398d7-kube-api-access-b2wxd\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:02.049794 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.049760 2578 generic.go:356] "Generic (PLEG): container finished" podID="f874e465-d322-4f8b-9f79-34c8965398d7" containerID="3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f" exitCode=0 Jul 08 17:27:02.050205 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.049805 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" Jul 08 17:27:02.050205 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.049846 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" event={"ID":"f874e465-d322-4f8b-9f79-34c8965398d7","Type":"ContainerDied","Data":"3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f"} Jul 08 17:27:02.050205 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.049909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2hm8r" event={"ID":"f874e465-d322-4f8b-9f79-34c8965398d7","Type":"ContainerDied","Data":"3ac13677af037164454f9ec114cd5b60f902691618dfd8f4aad694e3dd984212"} Jul 08 17:27:02.050205 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.049930 2578 scope.go:117] "RemoveContainer" containerID="3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f" Jul 08 17:27:02.058880 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.058844 2578 scope.go:117] "RemoveContainer" containerID="3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f" Jul 08 17:27:02.059188 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:27:02.059169 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f\": container with ID starting with 3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f not found: ID does not exist" containerID="3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f" Jul 08 17:27:02.059232 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.059197 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f"} err="failed to get container status \"3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f\": rpc error: code = NotFound desc = could not find container \"3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f\": container with ID starting with 3435e71e2aecbbdd3bf51442c9a08307d231cffa7ce40be8e54abbc19327ff8f not found: ID does not exist" Jul 08 17:27:02.066263 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.066233 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hm8r"] Jul 08 17:27:02.068519 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:02.068495 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2hm8r"] Jul 08 17:27:04.011692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:04.011659 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f874e465-d322-4f8b-9f79-34c8965398d7" path="/var/lib/kubelet/pods/f874e465-d322-4f8b-9f79-34c8965398d7/volumes" Jul 08 17:27:07.860816 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:07.860778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:07.961037 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:07.961003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:08.061787 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:08.061754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:08.103554 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:08.103519 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:27:08.103725 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:08.103582 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:27:08.126346 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:08.126282 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:27:08.590094 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:08.590066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:08.692001 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:08.691972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:09.103178 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:09.103152 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pt2d2" Jul 08 17:27:12.828008 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.827967 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k"] Jul 08 17:27:12.828700 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.828678 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f874e465-d322-4f8b-9f79-34c8965398d7" containerName="registry-server" Jul 08 17:27:12.828700 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.828703 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f874e465-d322-4f8b-9f79-34c8965398d7" containerName="registry-server" Jul 08 17:27:12.828912 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.828898 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f874e465-d322-4f8b-9f79-34c8965398d7" containerName="registry-server" Jul 08 17:27:12.834734 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.834706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:12.836793 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.836766 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k"] Jul 08 17:27:12.837371 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.837347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lrmw5\"" Jul 08 17:27:12.932737 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.932703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:12.932948 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.932758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tm56\" (UniqueName: \"kubernetes.io/projected/4e36bd00-972c-4632-b8df-681ae0df6eb7-kube-api-access-5tm56\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:12.932948 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:12.932822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:13.033514 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.033471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:13.033670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.033545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tm56\" (UniqueName: \"kubernetes.io/projected/4e36bd00-972c-4632-b8df-681ae0df6eb7-kube-api-access-5tm56\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:13.033670 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.033587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:13.033942 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.033919 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:13.033984 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.033928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:13.042231 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.042212 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tm56\" (UniqueName: \"kubernetes.io/projected/4e36bd00-972c-4632-b8df-681ae0df6eb7-kube-api-access-5tm56\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:13.144822 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.144793 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:13.222072 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.222042 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j"] Jul 08 17:27:13.227049 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.227025 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.234461 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.234261 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j"] Jul 08 17:27:13.235248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.235039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnxhl\" (UniqueName: \"kubernetes.io/projected/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-kube-api-access-fnxhl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.235248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.235110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.235248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.235219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.282529 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.282503 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k"] Jul 08 17:27:13.284743 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:27:13.284720 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e36bd00_972c_4632_b8df_681ae0df6eb7.slice/crio-500db3b69b05156bbb8064927e7c2c11a915f442fbb4641659406d762ae7753f WatchSource:0}: Error finding container 500db3b69b05156bbb8064927e7c2c11a915f442fbb4641659406d762ae7753f: Status 404 returned error can't find the container with id 500db3b69b05156bbb8064927e7c2c11a915f442fbb4641659406d762ae7753f Jul 08 17:27:13.336304 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.336274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.336402 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.336368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.336480 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.336464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxhl\" (UniqueName: \"kubernetes.io/projected/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-kube-api-access-fnxhl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.336600 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.336583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.336660 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.336645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.346256 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.346231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnxhl\" (UniqueName: \"kubernetes.io/projected/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-kube-api-access-fnxhl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.540555 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.540467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:13.624286 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.624257 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7"] Jul 08 17:27:13.628955 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.628938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.638722 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.635734 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7"] Jul 08 17:27:13.638722 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.638354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.638722 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.638406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtdn2\" (UniqueName: \"kubernetes.io/projected/b66e1469-04dc-4806-9231-0fbb7afc07d4-kube-api-access-mtdn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.638722 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.638449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.693880 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.693843 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j"] Jul 08 17:27:13.695813 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:27:13.695786 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea11bc44_fcf0_46a7_af03_fecaafbbe46c.slice/crio-b286a9e20a328a29ef489e0d768735ec39decb87e9a6d87a2e9a75ad3d8822f5 WatchSource:0}: Error finding container b286a9e20a328a29ef489e0d768735ec39decb87e9a6d87a2e9a75ad3d8822f5: Status 404 returned error can't find the container with id b286a9e20a328a29ef489e0d768735ec39decb87e9a6d87a2e9a75ad3d8822f5 Jul 08 17:27:13.738922 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.738900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtdn2\" (UniqueName: \"kubernetes.io/projected/b66e1469-04dc-4806-9231-0fbb7afc07d4-kube-api-access-mtdn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.739028 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.738945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.739028 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.739000 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.739306 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.739289 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.739344 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.739319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.747921 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.747900 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtdn2\" (UniqueName: \"kubernetes.io/projected/b66e1469-04dc-4806-9231-0fbb7afc07d4-kube-api-access-mtdn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:13.941814 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:13.941778 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:14.031683 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.031650 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk"] Jul 08 17:27:14.038450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.038429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.042009 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.041738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdssw\" (UniqueName: \"kubernetes.io/projected/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-kube-api-access-rdssw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.042009 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.041822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.042009 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.041925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.043992 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.043930 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk"] Jul 08 17:27:14.078312 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.078291 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7"] Jul 08 17:27:14.080293 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:27:14.080267 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66e1469_04dc_4806_9231_0fbb7afc07d4.slice/crio-68fb23653408ed9268cd40af08dbaf49423a9f0175ba317ca8bbb6e9a5f3f015 WatchSource:0}: Error finding container 68fb23653408ed9268cd40af08dbaf49423a9f0175ba317ca8bbb6e9a5f3f015: Status 404 returned error can't find the container with id 68fb23653408ed9268cd40af08dbaf49423a9f0175ba317ca8bbb6e9a5f3f015 Jul 08 17:27:14.107016 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.106991 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerID="a9cbcbbb6995f7162d6f38d7763c372976ebd4efabbe6132d908aaa10a1bd851" exitCode=0 Jul 08 17:27:14.107126 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.107070 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" event={"ID":"4e36bd00-972c-4632-b8df-681ae0df6eb7","Type":"ContainerDied","Data":"a9cbcbbb6995f7162d6f38d7763c372976ebd4efabbe6132d908aaa10a1bd851"} Jul 08 17:27:14.107126 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.107122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" event={"ID":"4e36bd00-972c-4632-b8df-681ae0df6eb7","Type":"ContainerStarted","Data":"500db3b69b05156bbb8064927e7c2c11a915f442fbb4641659406d762ae7753f"} Jul 08 17:27:14.108632 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.108612 2578 generic.go:356] "Generic (PLEG): container finished" podID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerID="56450433ac197feba964e01edca272f74e5298c6c4e54d6b026fc5bea1666979" exitCode=0 Jul 08 17:27:14.108740 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.108695 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" event={"ID":"ea11bc44-fcf0-46a7-af03-fecaafbbe46c","Type":"ContainerDied","Data":"56450433ac197feba964e01edca272f74e5298c6c4e54d6b026fc5bea1666979"} Jul 08 17:27:14.108740 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.108737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" event={"ID":"ea11bc44-fcf0-46a7-af03-fecaafbbe46c","Type":"ContainerStarted","Data":"b286a9e20a328a29ef489e0d768735ec39decb87e9a6d87a2e9a75ad3d8822f5"} Jul 08 17:27:14.110074 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.110057 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" event={"ID":"b66e1469-04dc-4806-9231-0fbb7afc07d4","Type":"ContainerStarted","Data":"68fb23653408ed9268cd40af08dbaf49423a9f0175ba317ca8bbb6e9a5f3f015"} Jul 08 17:27:14.142559 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.142534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdssw\" (UniqueName: \"kubernetes.io/projected/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-kube-api-access-rdssw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.142671 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.142602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.142671 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.142638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.143065 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.143041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.143120 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.143056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.150313 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.150289 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdssw\" (UniqueName: \"kubernetes.io/projected/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-kube-api-access-rdssw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.364583 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.364483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:14.497040 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:14.497008 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk"] Jul 08 17:27:14.499907 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:27:14.499882 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2aa6bc_1622_48b1_bf0b_3f5b7bab772e.slice/crio-08a1d03fbc6dbba170367a6b7bb2c000209276f567e86f84b420feed22cc3fdb WatchSource:0}: Error finding container 08a1d03fbc6dbba170367a6b7bb2c000209276f567e86f84b420feed22cc3fdb: Status 404 returned error can't find the container with id 08a1d03fbc6dbba170367a6b7bb2c000209276f567e86f84b420feed22cc3fdb Jul 08 17:27:15.117256 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:15.117225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" event={"ID":"ea11bc44-fcf0-46a7-af03-fecaafbbe46c","Type":"ContainerStarted","Data":"fa9bb321abc7b784c1a667278f5c83de6fdb32c45c08b04b7b2d9ba1de469ada"} Jul 08 17:27:15.118787 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:15.118761 2578 generic.go:356] "Generic (PLEG): container finished" podID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerID="b9a7ed39f27b347f2174ce8a300854e756e2d2a27d6ec2939bb0f73b9b1f8643" exitCode=0 Jul 08 17:27:15.118925 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:15.118829 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" event={"ID":"b66e1469-04dc-4806-9231-0fbb7afc07d4","Type":"ContainerDied","Data":"b9a7ed39f27b347f2174ce8a300854e756e2d2a27d6ec2939bb0f73b9b1f8643"} Jul 08 17:27:15.120446 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:15.120420 2578 generic.go:356] "Generic (PLEG): container finished" podID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerID="157c617f8816f2c5757d984cae4e905d5ffd64c9512b6ee9f86c65d97fced7f6" exitCode=0 Jul 08 17:27:15.120542 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:15.120466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" event={"ID":"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e","Type":"ContainerDied","Data":"157c617f8816f2c5757d984cae4e905d5ffd64c9512b6ee9f86c65d97fced7f6"} Jul 08 17:27:15.120542 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:15.120510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" event={"ID":"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e","Type":"ContainerStarted","Data":"08a1d03fbc6dbba170367a6b7bb2c000209276f567e86f84b420feed22cc3fdb"} Jul 08 17:27:16.127383 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:16.127298 2578 generic.go:356] "Generic (PLEG): container finished" podID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerID="c047cb8478424f789b3335538c345423e54619f676a2ffc1f47216ffaac9c2a7" exitCode=0 Jul 08 17:27:16.127383 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:16.127357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" event={"ID":"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e","Type":"ContainerDied","Data":"c047cb8478424f789b3335538c345423e54619f676a2ffc1f47216ffaac9c2a7"} Jul 08 17:27:16.129296 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:16.129273 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerID="ffe59068440159bff412c0337de9382238c39ea9d8e2c830cdc8ec366b476178" exitCode=0 Jul 08 17:27:16.129429 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:16.129353 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" event={"ID":"4e36bd00-972c-4632-b8df-681ae0df6eb7","Type":"ContainerDied","Data":"ffe59068440159bff412c0337de9382238c39ea9d8e2c830cdc8ec366b476178"} Jul 08 17:27:16.131408 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:16.131333 2578 generic.go:356] "Generic (PLEG): container finished" podID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerID="fa9bb321abc7b784c1a667278f5c83de6fdb32c45c08b04b7b2d9ba1de469ada" exitCode=0 Jul 08 17:27:16.131408 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:16.131370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" event={"ID":"ea11bc44-fcf0-46a7-af03-fecaafbbe46c","Type":"ContainerDied","Data":"fa9bb321abc7b784c1a667278f5c83de6fdb32c45c08b04b7b2d9ba1de469ada"} Jul 08 17:27:17.138961 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:17.138925 2578 generic.go:356] "Generic (PLEG): container finished" podID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerID="f60a89821d3eb9cf9a8068bdef8cf3d3480ba5d63422c968369307329d7f8cd6" exitCode=0 Jul 08 17:27:17.139378 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:17.139007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" event={"ID":"b66e1469-04dc-4806-9231-0fbb7afc07d4","Type":"ContainerDied","Data":"f60a89821d3eb9cf9a8068bdef8cf3d3480ba5d63422c968369307329d7f8cd6"} Jul 08 17:27:17.141201 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:17.141158 2578 generic.go:356] "Generic (PLEG): container finished" podID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerID="b35b6d68abba91709195b9bda92e30870e2c281d44a57f24432debcc7f79a263" exitCode=0 Jul 08 17:27:17.141292 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:17.141241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" event={"ID":"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e","Type":"ContainerDied","Data":"b35b6d68abba91709195b9bda92e30870e2c281d44a57f24432debcc7f79a263"} Jul 08 17:27:17.143383 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:17.143360 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerID="e542c9ca4fd554efbeb78d6d9327cf4694422c6fc132fba8c9e8844aff225d2e" exitCode=0 Jul 08 17:27:17.143482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:17.143446 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" event={"ID":"4e36bd00-972c-4632-b8df-681ae0df6eb7","Type":"ContainerDied","Data":"e542c9ca4fd554efbeb78d6d9327cf4694422c6fc132fba8c9e8844aff225d2e"} Jul 08 17:27:17.145479 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:17.145460 2578 generic.go:356] "Generic (PLEG): container finished" podID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerID="f0ed0c798a8df68cf88f82718344f4c40e5b654548a2b796b06f0a50d498f072" exitCode=0 Jul 08 17:27:17.145608 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:17.145487 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" event={"ID":"ea11bc44-fcf0-46a7-af03-fecaafbbe46c","Type":"ContainerDied","Data":"f0ed0c798a8df68cf88f82718344f4c40e5b654548a2b796b06f0a50d498f072"} Jul 08 17:27:18.161210 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.161179 2578 generic.go:356] "Generic (PLEG): container finished" podID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerID="4fdb792b968a298df36ccb741465e3845131c64c0ac3a3e1c75b5675f64b1221" exitCode=0 Jul 08 17:27:18.161606 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.161256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" event={"ID":"b66e1469-04dc-4806-9231-0fbb7afc07d4","Type":"ContainerDied","Data":"4fdb792b968a298df36ccb741465e3845131c64c0ac3a3e1c75b5675f64b1221"} Jul 08 17:27:18.308195 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.308162 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:18.357450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.357423 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:18.360229 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.360210 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:18.371358 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371331 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnxhl\" (UniqueName: \"kubernetes.io/projected/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-kube-api-access-fnxhl\") pod \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " Jul 08 17:27:18.371482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371386 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-bundle\") pod \"4e36bd00-972c-4632-b8df-681ae0df6eb7\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " Jul 08 17:27:18.371482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371415 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdssw\" (UniqueName: \"kubernetes.io/projected/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-kube-api-access-rdssw\") pod \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " Jul 08 17:27:18.371482 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371472 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-util\") pod \"4e36bd00-972c-4632-b8df-681ae0df6eb7\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " Jul 08 17:27:18.371650 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371511 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-bundle\") pod \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " Jul 08 17:27:18.371650 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371552 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tm56\" (UniqueName: \"kubernetes.io/projected/4e36bd00-972c-4632-b8df-681ae0df6eb7-kube-api-access-5tm56\") pod \"4e36bd00-972c-4632-b8df-681ae0df6eb7\" (UID: \"4e36bd00-972c-4632-b8df-681ae0df6eb7\") " Jul 08 17:27:18.371650 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371580 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-bundle\") pod \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " Jul 08 17:27:18.371650 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371617 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-util\") pod \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\" (UID: \"ea11bc44-fcf0-46a7-af03-fecaafbbe46c\") " Jul 08 17:27:18.372003 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.371662 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-util\") pod \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\" (UID: \"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e\") " Jul 08 17:27:18.372058 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.372020 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-bundle" (OuterVolumeSpecName: "bundle") pod "ea11bc44-fcf0-46a7-af03-fecaafbbe46c" (UID: "ea11bc44-fcf0-46a7-af03-fecaafbbe46c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:27:18.372511 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.372455 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-bundle" (OuterVolumeSpecName: "bundle") pod "be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" (UID: "be2aa6bc-1622-48b1-bf0b-3f5b7bab772e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:27:18.372688 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.372665 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-bundle" (OuterVolumeSpecName: "bundle") pod "4e36bd00-972c-4632-b8df-681ae0df6eb7" (UID: "4e36bd00-972c-4632-b8df-681ae0df6eb7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:27:18.373907 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.373879 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-kube-api-access-fnxhl" (OuterVolumeSpecName: "kube-api-access-fnxhl") pod "ea11bc44-fcf0-46a7-af03-fecaafbbe46c" (UID: "ea11bc44-fcf0-46a7-af03-fecaafbbe46c"). InnerVolumeSpecName "kube-api-access-fnxhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:27:18.374212 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.374173 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-kube-api-access-rdssw" (OuterVolumeSpecName: "kube-api-access-rdssw") pod "be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" (UID: "be2aa6bc-1622-48b1-bf0b-3f5b7bab772e"). InnerVolumeSpecName "kube-api-access-rdssw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:27:18.375025 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.374990 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e36bd00-972c-4632-b8df-681ae0df6eb7-kube-api-access-5tm56" (OuterVolumeSpecName: "kube-api-access-5tm56") pod "4e36bd00-972c-4632-b8df-681ae0df6eb7" (UID: "4e36bd00-972c-4632-b8df-681ae0df6eb7"). InnerVolumeSpecName "kube-api-access-5tm56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:27:18.379674 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.379648 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-util" (OuterVolumeSpecName: "util") pod "be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" (UID: "be2aa6bc-1622-48b1-bf0b-3f5b7bab772e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:27:18.379797 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.379770 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-util" (OuterVolumeSpecName: "util") pod "4e36bd00-972c-4632-b8df-681ae0df6eb7" (UID: "4e36bd00-972c-4632-b8df-681ae0df6eb7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:27:18.382067 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.382047 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-util" (OuterVolumeSpecName: "util") pod "ea11bc44-fcf0-46a7-af03-fecaafbbe46c" (UID: "ea11bc44-fcf0-46a7-af03-fecaafbbe46c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:27:18.473332 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473257 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-util\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.473332 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473286 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-bundle\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.473332 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473297 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tm56\" (UniqueName: \"kubernetes.io/projected/4e36bd00-972c-4632-b8df-681ae0df6eb7-kube-api-access-5tm56\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.473332 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473307 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-bundle\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.473332 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473316 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-util\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.473614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473343 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-util\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.473614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473353 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnxhl\" (UniqueName: \"kubernetes.io/projected/ea11bc44-fcf0-46a7-af03-fecaafbbe46c-kube-api-access-fnxhl\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.473614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473361 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e36bd00-972c-4632-b8df-681ae0df6eb7-bundle\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.473614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.473371 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdssw\" (UniqueName: \"kubernetes.io/projected/be2aa6bc-1622-48b1-bf0b-3f5b7bab772e-kube-api-access-rdssw\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:18.682641 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.682612 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:18.782889 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:18.782784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:19.170675 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.170638 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" event={"ID":"4e36bd00-972c-4632-b8df-681ae0df6eb7","Type":"ContainerDied","Data":"500db3b69b05156bbb8064927e7c2c11a915f442fbb4641659406d762ae7753f"} Jul 08 17:27:19.171168 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.170694 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k" Jul 08 17:27:19.171168 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.170697 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="500db3b69b05156bbb8064927e7c2c11a915f442fbb4641659406d762ae7753f" Jul 08 17:27:19.172933 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.172911 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" Jul 08 17:27:19.173046 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.172946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j" event={"ID":"ea11bc44-fcf0-46a7-af03-fecaafbbe46c","Type":"ContainerDied","Data":"b286a9e20a328a29ef489e0d768735ec39decb87e9a6d87a2e9a75ad3d8822f5"} Jul 08 17:27:19.173046 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.172989 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b286a9e20a328a29ef489e0d768735ec39decb87e9a6d87a2e9a75ad3d8822f5" Jul 08 17:27:19.174665 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.174647 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" Jul 08 17:27:19.174759 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.174678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk" event={"ID":"be2aa6bc-1622-48b1-bf0b-3f5b7bab772e","Type":"ContainerDied","Data":"08a1d03fbc6dbba170367a6b7bb2c000209276f567e86f84b420feed22cc3fdb"} Jul 08 17:27:19.174759 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.174710 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08a1d03fbc6dbba170367a6b7bb2c000209276f567e86f84b420feed22cc3fdb" Jul 08 17:27:19.304609 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.304582 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:19.381181 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.381145 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-util\") pod \"b66e1469-04dc-4806-9231-0fbb7afc07d4\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " Jul 08 17:27:19.381380 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.381190 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-bundle\") pod \"b66e1469-04dc-4806-9231-0fbb7afc07d4\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " Jul 08 17:27:19.381380 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.381246 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtdn2\" (UniqueName: \"kubernetes.io/projected/b66e1469-04dc-4806-9231-0fbb7afc07d4-kube-api-access-mtdn2\") pod \"b66e1469-04dc-4806-9231-0fbb7afc07d4\" (UID: \"b66e1469-04dc-4806-9231-0fbb7afc07d4\") " Jul 08 17:27:19.381718 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.381687 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-bundle" (OuterVolumeSpecName: "bundle") pod "b66e1469-04dc-4806-9231-0fbb7afc07d4" (UID: "b66e1469-04dc-4806-9231-0fbb7afc07d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:27:19.383393 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.383368 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b66e1469-04dc-4806-9231-0fbb7afc07d4-kube-api-access-mtdn2" (OuterVolumeSpecName: "kube-api-access-mtdn2") pod "b66e1469-04dc-4806-9231-0fbb7afc07d4" (UID: "b66e1469-04dc-4806-9231-0fbb7afc07d4"). InnerVolumeSpecName "kube-api-access-mtdn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:27:19.465623 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.465541 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-util" (OuterVolumeSpecName: "util") pod "b66e1469-04dc-4806-9231-0fbb7afc07d4" (UID: "b66e1469-04dc-4806-9231-0fbb7afc07d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:27:19.481962 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.481927 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-bundle\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:19.481962 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.481957 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtdn2\" (UniqueName: \"kubernetes.io/projected/b66e1469-04dc-4806-9231-0fbb7afc07d4-kube-api-access-mtdn2\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:19.481962 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:19.481968 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e1469-04dc-4806-9231-0fbb7afc07d4-util\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:27:20.181055 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:20.181025 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" Jul 08 17:27:20.181461 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:20.181029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7" event={"ID":"b66e1469-04dc-4806-9231-0fbb7afc07d4","Type":"ContainerDied","Data":"68fb23653408ed9268cd40af08dbaf49423a9f0175ba317ca8bbb6e9a5f3f015"} Jul 08 17:27:20.181461 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:20.181147 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68fb23653408ed9268cd40af08dbaf49423a9f0175ba317ca8bbb6e9a5f3f015" Jul 08 17:27:25.936333 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:25.936299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:28.588629 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.588595 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp"] Jul 08 17:27:28.589044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.588962 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerName="util" Jul 08 17:27:28.589044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.588978 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerName="util" Jul 08 17:27:28.589044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.588988 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerName="pull" Jul 08 17:27:28.589044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.588995 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerName="pull" Jul 08 17:27:28.589044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589005 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerName="extract" Jul 08 17:27:28.589044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589014 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerName="extract" Jul 08 17:27:28.589044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589027 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerName="pull" Jul 08 17:27:28.589044 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589034 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerName="pull" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589048 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerName="pull" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589057 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerName="pull" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589066 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589072 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589078 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589083 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589091 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerName="pull" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589096 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerName="pull" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589104 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerName="util" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589109 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerName="util" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589115 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589120 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589128 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerName="util" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589133 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerName="util" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589144 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerName="util" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589148 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerName="util" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589210 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2aa6bc-1622-48b1-bf0b-3f5b7bab772e" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589218 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e36bd00-972c-4632-b8df-681ae0df6eb7" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589224 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea11bc44-fcf0-46a7-af03-fecaafbbe46c" containerName="extract" Jul 08 17:27:28.589280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.589230 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b66e1469-04dc-4806-9231-0fbb7afc07d4" containerName="extract" Jul 08 17:27:28.591925 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.591908 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" Jul 08 17:27:28.598040 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.598018 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 17:27:28.598161 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.598107 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wlbhq\"" Jul 08 17:27:28.605990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.605962 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp"] Jul 08 17:27:28.657607 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.657570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmkrn\" (UniqueName: \"kubernetes.io/projected/df2b6b56-9c38-4456-adad-a76a2472672f-kube-api-access-pmkrn\") pod \"dns-operator-controller-manager-864dd78c4c-nb4jp\" (UID: \"df2b6b56-9c38-4456-adad-a76a2472672f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" Jul 08 17:27:28.758162 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.758129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmkrn\" (UniqueName: \"kubernetes.io/projected/df2b6b56-9c38-4456-adad-a76a2472672f-kube-api-access-pmkrn\") pod \"dns-operator-controller-manager-864dd78c4c-nb4jp\" (UID: \"df2b6b56-9c38-4456-adad-a76a2472672f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" Jul 08 17:27:28.766534 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.766510 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmkrn\" (UniqueName: \"kubernetes.io/projected/df2b6b56-9c38-4456-adad-a76a2472672f-kube-api-access-pmkrn\") pod \"dns-operator-controller-manager-864dd78c4c-nb4jp\" (UID: \"df2b6b56-9c38-4456-adad-a76a2472672f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" Jul 08 17:27:28.908242 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:28.908214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" Jul 08 17:27:29.044815 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:29.044791 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp"] Jul 08 17:27:29.046690 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:27:29.046662 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2b6b56_9c38_4456_adad_a76a2472672f.slice/crio-4dbf105e944cfc24fb007d9c52c8dd1722b450c8e748040ade843a936ecff0ef WatchSource:0}: Error finding container 4dbf105e944cfc24fb007d9c52c8dd1722b450c8e748040ade843a936ecff0ef: Status 404 returned error can't find the container with id 4dbf105e944cfc24fb007d9c52c8dd1722b450c8e748040ade843a936ecff0ef Jul 08 17:27:29.227429 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:29.227348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" event={"ID":"df2b6b56-9c38-4456-adad-a76a2472672f","Type":"ContainerStarted","Data":"4dbf105e944cfc24fb007d9c52c8dd1722b450c8e748040ade843a936ecff0ef"} Jul 08 17:27:29.334297 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:29.334259 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:30.127136 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:30.127104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:32.245441 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.245399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" event={"ID":"df2b6b56-9c38-4456-adad-a76a2472672f","Type":"ContainerStarted","Data":"a69ecb6382cd47bd9a427f048c42595e4ba325e342bebfb0e92dc0e890c7ecc4"} Jul 08 17:27:32.245819 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.245496 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" Jul 08 17:27:32.263898 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.263838 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" podStartSLOduration=1.952878431 podStartE2EDuration="4.263823052s" totalImagesPullingTime="2.310944621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:32.261610801 +0000 UTC m=+502.720823333" watchObservedRunningTime="2026-07-08 17:27:32.263823052 +0000 UTC m=+502.723035584" Jul 08 17:27:32.624153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.624082 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k"] Jul 08 17:27:32.627409 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.627393 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" Jul 08 17:27:32.629935 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.629918 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2n6lx\"" Jul 08 17:27:32.639959 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.639937 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k"] Jul 08 17:27:32.695426 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.695395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zsd5\" (UniqueName: \"kubernetes.io/projected/8a9d314b-be0a-4e09-931a-b613c2f0a535-kube-api-access-4zsd5\") pod \"authorino-operator-75cc8d5cb7-wmn6k\" (UID: \"8a9d314b-be0a-4e09-931a-b613c2f0a535\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" Jul 08 17:27:32.796275 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.796226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsd5\" (UniqueName: \"kubernetes.io/projected/8a9d314b-be0a-4e09-931a-b613c2f0a535-kube-api-access-4zsd5\") pod \"authorino-operator-75cc8d5cb7-wmn6k\" (UID: \"8a9d314b-be0a-4e09-931a-b613c2f0a535\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" Jul 08 17:27:32.809911 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.809881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zsd5\" (UniqueName: \"kubernetes.io/projected/8a9d314b-be0a-4e09-931a-b613c2f0a535-kube-api-access-4zsd5\") pod \"authorino-operator-75cc8d5cb7-wmn6k\" (UID: \"8a9d314b-be0a-4e09-931a-b613c2f0a535\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" Jul 08 17:27:32.937268 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:32.937235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" Jul 08 17:27:33.072231 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:33.072209 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k"] Jul 08 17:27:33.074575 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:27:33.074549 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9d314b_be0a_4e09_931a_b613c2f0a535.slice/crio-fab05ff7604437eb57d1cc12bd221f7990050851171d50d7fb363f0335ea4a87 WatchSource:0}: Error finding container fab05ff7604437eb57d1cc12bd221f7990050851171d50d7fb363f0335ea4a87: Status 404 returned error can't find the container with id fab05ff7604437eb57d1cc12bd221f7990050851171d50d7fb363f0335ea4a87 Jul 08 17:27:33.251643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:33.251546 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" event={"ID":"8a9d314b-be0a-4e09-931a-b613c2f0a535","Type":"ContainerStarted","Data":"fab05ff7604437eb57d1cc12bd221f7990050851171d50d7fb363f0335ea4a87"} Jul 08 17:27:33.730968 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:33.730929 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:33.980866 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:33.980801 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:34.100280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:34.100101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:36.034294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:36.034253 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:36.270725 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:36.270691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" event={"ID":"8a9d314b-be0a-4e09-931a-b613c2f0a535","Type":"ContainerStarted","Data":"35454cdc0d958e7823e7053081b3458a17f86d4c8033f1afc9ac3eb5cdb679be"} Jul 08 17:27:36.270921 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:36.270750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" Jul 08 17:27:36.296082 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:36.295988 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" podStartSLOduration=1.881165594 podStartE2EDuration="4.295972388s" totalImagesPullingTime="2.414806794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:36.293985046 +0000 UTC m=+506.753197577" watchObservedRunningTime="2026-07-08 17:27:36.295972388 +0000 UTC m=+506.755184989" Jul 08 17:27:36.730596 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:36.730559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:37.009471 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:37.009372 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:38.784330 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:38.784292 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:40.835960 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:40.835923 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt"] Jul 08 17:27:40.838466 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:40.838444 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:40.842549 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:40.842528 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hc4qn\"" Jul 08 17:27:40.861142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:40.861109 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt"] Jul 08 17:27:40.968503 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:40.968462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" (UID: \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:40.968680 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:40.968525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxv59\" (UniqueName: \"kubernetes.io/projected/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-kube-api-access-mxv59\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" (UID: \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:41.069561 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:41.069519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" (UID: \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:41.069755 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:41.069590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxv59\" (UniqueName: \"kubernetes.io/projected/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-kube-api-access-mxv59\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" (UID: \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:41.069954 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:41.069932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" (UID: \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:41.085212 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:41.085190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxv59\" (UniqueName: \"kubernetes.io/projected/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-kube-api-access-mxv59\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" (UID: \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:41.148063 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:41.148033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:41.287392 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:41.287368 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt"] Jul 08 17:27:41.289070 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:27:41.289044 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e883d5_8f50_40a6_a6c2_d6493eb51f2b.slice/crio-2670294ba260ee851df90bf741908ea9413415e55ce38bd286e55eef10a8f156 WatchSource:0}: Error finding container 2670294ba260ee851df90bf741908ea9413415e55ce38bd286e55eef10a8f156: Status 404 returned error can't find the container with id 2670294ba260ee851df90bf741908ea9413415e55ce38bd286e55eef10a8f156 Jul 08 17:27:41.301523 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:41.301496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" event={"ID":"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b","Type":"ContainerStarted","Data":"2670294ba260ee851df90bf741908ea9413415e55ce38bd286e55eef10a8f156"} Jul 08 17:27:41.950248 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:41.950209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:42.046355 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:42.046313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:43.254286 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:43.254257 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nb4jp" Jul 08 17:27:47.278183 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:47.278150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wmn6k" Jul 08 17:27:47.333583 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:47.333533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:47.433275 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:47.433241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:47.767503 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:47.767469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:47.861430 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:47.861383 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:49.349153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:49.349115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" event={"ID":"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b","Type":"ContainerStarted","Data":"e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb"} Jul 08 17:27:49.349541 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:49.349242 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:27:49.372418 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:49.372357 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" podStartSLOduration=2.239100171 podStartE2EDuration="9.372337416s" totalImagesPullingTime="7.133237245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:49.372172745 +0000 UTC m=+519.831385278" watchObservedRunningTime="2026-07-08 17:27:49.372337416 +0000 UTC m=+519.831549948" Jul 08 17:27:51.354795 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:51.354759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:51.461478 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:51.461439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:51.561273 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:51.561240 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:51.660427 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:51.660396 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:53.909153 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:53.909122 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:27:54.008620 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:27:54.008570 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:00.356531 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:00.356502 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:00.550285 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:00.550232 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:00.651281 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:00.651241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:02.062876 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.062828 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt"] Jul 08 17:28:02.063268 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.063027 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" containerName="manager" containerID="cri-o://e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb" gracePeriod=2 Jul 08 17:28:02.071380 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:28:02.071336 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\": pods \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:02.072592 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.072534 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt"] Jul 08 17:28:02.090010 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.089983 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f"] Jul 08 17:28:02.090368 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.090351 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" containerName="manager" Jul 08 17:28:02.090446 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.090371 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" containerName="manager" Jul 08 17:28:02.090499 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.090473 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" containerName="manager" Jul 08 17:28:02.092357 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.092336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:02.111355 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.111318 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f"] Jul 08 17:28:02.137907 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:28:02.137869 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:02.260879 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.260831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsd7f\" (UniqueName: \"kubernetes.io/projected/816897cd-daa9-4f85-a3eb-df37895420a8-kube-api-access-hsd7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75f7f\" (UID: \"816897cd-daa9-4f85-a3eb-df37895420a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:02.261048 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.260969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816897cd-daa9-4f85-a3eb-df37895420a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75f7f\" (UID: \"816897cd-daa9-4f85-a3eb-df37895420a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:02.304260 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.304237 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:02.306588 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:28:02.306565 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:02.362165 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.362080 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxv59\" (UniqueName: \"kubernetes.io/projected/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-kube-api-access-mxv59\") pod \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\" (UID: \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\") " Jul 08 17:28:02.362165 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.362119 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-extensions-socket-volume\") pod \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\" (UID: \"d1e883d5-8f50-40a6-a6c2-d6493eb51f2b\") " Jul 08 17:28:02.362378 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.362194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsd7f\" (UniqueName: \"kubernetes.io/projected/816897cd-daa9-4f85-a3eb-df37895420a8-kube-api-access-hsd7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75f7f\" (UID: \"816897cd-daa9-4f85-a3eb-df37895420a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:02.362378 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.362246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816897cd-daa9-4f85-a3eb-df37895420a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75f7f\" (UID: \"816897cd-daa9-4f85-a3eb-df37895420a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:02.362603 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.362584 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816897cd-daa9-4f85-a3eb-df37895420a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75f7f\" (UID: \"816897cd-daa9-4f85-a3eb-df37895420a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:02.362659 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.362639 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" (UID: "d1e883d5-8f50-40a6-a6c2-d6493eb51f2b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:28:02.364315 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.364293 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-kube-api-access-mxv59" (OuterVolumeSpecName: "kube-api-access-mxv59") pod "d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" (UID: "d1e883d5-8f50-40a6-a6c2-d6493eb51f2b"). InnerVolumeSpecName "kube-api-access-mxv59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:28:02.379900 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.379877 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsd7f\" (UniqueName: \"kubernetes.io/projected/816897cd-daa9-4f85-a3eb-df37895420a8-kube-api-access-hsd7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75f7f\" (UID: \"816897cd-daa9-4f85-a3eb-df37895420a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:02.416399 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.416361 2578 generic.go:356] "Generic (PLEG): container finished" podID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" containerID="e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb" exitCode=0 Jul 08 17:28:02.416555 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.416409 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:02.416555 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.416423 2578 scope.go:117] "RemoveContainer" containerID="e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb" Jul 08 17:28:02.418960 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:28:02.418934 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:02.425974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.425959 2578 scope.go:117] "RemoveContainer" containerID="e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb" Jul 08 17:28:02.426243 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:28:02.426227 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb\": container with ID starting with e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb not found: ID does not exist" containerID="e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb" Jul 08 17:28:02.426294 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.426249 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb"} err="failed to get container status \"e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb\": rpc error: code = NotFound desc = could not find container \"e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb\": container with ID starting with e37b65d8646118d029ccfdea86857b1e69915d726db755b3f9f29da0a64069eb not found: ID does not exist" Jul 08 17:28:02.427530 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:28:02.427504 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:02.451112 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.451088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:02.462646 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.462626 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxv59\" (UniqueName: \"kubernetes.io/projected/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-kube-api-access-mxv59\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:28:02.462734 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.462648 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b-extensions-socket-volume\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:28:02.589216 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:02.589191 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f"] Jul 08 17:28:02.590806 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:28:02.590775 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816897cd_daa9_4f85_a3eb_df37895420a8.slice/crio-415204f0136d65cffbc8e96fea0173b9ee3732ece656238827f8ec6bfd374037 WatchSource:0}: Error finding container 415204f0136d65cffbc8e96fea0173b9ee3732ece656238827f8ec6bfd374037: Status 404 returned error can't find the container with id 415204f0136d65cffbc8e96fea0173b9ee3732ece656238827f8ec6bfd374037 Jul 08 17:28:03.424050 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:03.424007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" event={"ID":"816897cd-daa9-4f85-a3eb-df37895420a8","Type":"ContainerStarted","Data":"3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858"} Jul 08 17:28:03.424458 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:03.424063 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" event={"ID":"816897cd-daa9-4f85-a3eb-df37895420a8","Type":"ContainerStarted","Data":"415204f0136d65cffbc8e96fea0173b9ee3732ece656238827f8ec6bfd374037"} Jul 08 17:28:03.424458 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:03.424126 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:03.469048 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:03.468993 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" podStartSLOduration=1.468977299 podStartE2EDuration="1.468977299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:03.466904962 +0000 UTC m=+533.926117493" watchObservedRunningTime="2026-07-08 17:28:03.468977299 +0000 UTC m=+533.928189830" Jul 08 17:28:03.469935 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:28:03.469903 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l5qgt\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l5qgt" Jul 08 17:28:04.012364 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:04.012330 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e883d5-8f50-40a6-a6c2-d6493eb51f2b" path="/var/lib/kubelet/pods/d1e883d5-8f50-40a6-a6c2-d6493eb51f2b/volumes" Jul 08 17:28:05.944867 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:05.944824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:06.045251 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:06.045219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:06.344258 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:06.344165 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:06.444762 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:06.444724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:09.741760 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:09.741698 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:09.842100 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:09.842069 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:12.299172 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:12.299139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:12.399826 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:12.399796 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:14.432589 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:14.432556 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:17.066755 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:17.066710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:17.142787 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:17.142749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:18.965695 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:18.965656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:19.065445 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:19.065408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:34.255373 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.255338 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f"] Jul 08 17:28:34.255780 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.255580 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" podUID="816897cd-daa9-4f85-a3eb-df37895420a8" containerName="manager" containerID="cri-o://3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858" gracePeriod=10 Jul 08 17:28:34.505932 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.505872 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:34.529782 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.529756 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv"] Jul 08 17:28:34.530113 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.530100 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816897cd-daa9-4f85-a3eb-df37895420a8" containerName="manager" Jul 08 17:28:34.530165 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.530114 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="816897cd-daa9-4f85-a3eb-df37895420a8" containerName="manager" Jul 08 17:28:34.530207 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.530180 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="816897cd-daa9-4f85-a3eb-df37895420a8" containerName="manager" Jul 08 17:28:34.531929 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.531910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:34.555622 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.555589 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv"] Jul 08 17:28:34.596084 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.596051 2578 generic.go:356] "Generic (PLEG): container finished" podID="816897cd-daa9-4f85-a3eb-df37895420a8" containerID="3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858" exitCode=0 Jul 08 17:28:34.596259 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.596097 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" Jul 08 17:28:34.596259 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.596138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" event={"ID":"816897cd-daa9-4f85-a3eb-df37895420a8","Type":"ContainerDied","Data":"3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858"} Jul 08 17:28:34.596259 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.596190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" event={"ID":"816897cd-daa9-4f85-a3eb-df37895420a8","Type":"ContainerDied","Data":"415204f0136d65cffbc8e96fea0173b9ee3732ece656238827f8ec6bfd374037"} Jul 08 17:28:34.596259 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.596214 2578 scope.go:117] "RemoveContainer" containerID="3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858" Jul 08 17:28:34.604757 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.604741 2578 scope.go:117] "RemoveContainer" containerID="3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858" Jul 08 17:28:34.605024 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:28:34.605005 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858\": container with ID starting with 3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858 not found: ID does not exist" containerID="3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858" Jul 08 17:28:34.605103 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.605033 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858"} err="failed to get container status \"3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858\": rpc error: code = NotFound desc = could not find container \"3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858\": container with ID starting with 3c09fb332e64b347cb46a754ce8fbdace7767238aff27e041016db78df498858 not found: ID does not exist" Jul 08 17:28:34.630881 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.630845 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsd7f\" (UniqueName: \"kubernetes.io/projected/816897cd-daa9-4f85-a3eb-df37895420a8-kube-api-access-hsd7f\") pod \"816897cd-daa9-4f85-a3eb-df37895420a8\" (UID: \"816897cd-daa9-4f85-a3eb-df37895420a8\") " Jul 08 17:28:34.630987 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.630946 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816897cd-daa9-4f85-a3eb-df37895420a8-extensions-socket-volume\") pod \"816897cd-daa9-4f85-a3eb-df37895420a8\" (UID: \"816897cd-daa9-4f85-a3eb-df37895420a8\") " Jul 08 17:28:34.631046 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.631003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e56429-cdba-4d68-8686-a612b2d2b28c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hppkv\" (UID: \"01e56429-cdba-4d68-8686-a612b2d2b28c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:34.631111 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.631061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stbwx\" (UniqueName: \"kubernetes.io/projected/01e56429-cdba-4d68-8686-a612b2d2b28c-kube-api-access-stbwx\") pod \"kuadrant-operator-controller-manager-86878c769f-hppkv\" (UID: \"01e56429-cdba-4d68-8686-a612b2d2b28c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:34.631316 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.631295 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816897cd-daa9-4f85-a3eb-df37895420a8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "816897cd-daa9-4f85-a3eb-df37895420a8" (UID: "816897cd-daa9-4f85-a3eb-df37895420a8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:28:34.632690 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.632671 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816897cd-daa9-4f85-a3eb-df37895420a8-kube-api-access-hsd7f" (OuterVolumeSpecName: "kube-api-access-hsd7f") pod "816897cd-daa9-4f85-a3eb-df37895420a8" (UID: "816897cd-daa9-4f85-a3eb-df37895420a8"). InnerVolumeSpecName "kube-api-access-hsd7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:28:34.732399 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.732366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbwx\" (UniqueName: \"kubernetes.io/projected/01e56429-cdba-4d68-8686-a612b2d2b28c-kube-api-access-stbwx\") pod \"kuadrant-operator-controller-manager-86878c769f-hppkv\" (UID: \"01e56429-cdba-4d68-8686-a612b2d2b28c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:34.732554 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.732421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e56429-cdba-4d68-8686-a612b2d2b28c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hppkv\" (UID: \"01e56429-cdba-4d68-8686-a612b2d2b28c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:34.732554 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.732465 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/816897cd-daa9-4f85-a3eb-df37895420a8-extensions-socket-volume\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:28:34.732554 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.732475 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsd7f\" (UniqueName: \"kubernetes.io/projected/816897cd-daa9-4f85-a3eb-df37895420a8-kube-api-access-hsd7f\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:28:34.732773 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.732759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e56429-cdba-4d68-8686-a612b2d2b28c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hppkv\" (UID: \"01e56429-cdba-4d68-8686-a612b2d2b28c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:34.743507 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.743478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbwx\" (UniqueName: \"kubernetes.io/projected/01e56429-cdba-4d68-8686-a612b2d2b28c-kube-api-access-stbwx\") pod \"kuadrant-operator-controller-manager-86878c769f-hppkv\" (UID: \"01e56429-cdba-4d68-8686-a612b2d2b28c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:34.842796 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.842714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:34.924768 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.924720 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f"] Jul 08 17:28:34.929025 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.928996 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f"] Jul 08 17:28:34.976443 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:34.976401 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv"] Jul 08 17:28:34.978863 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:28:34.978823 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e56429_cdba_4d68_8686_a612b2d2b28c.slice/crio-5f346dec909ae57ee66d7967e9811e93b5df08f4b3d4a97ce73a6278a15991ec WatchSource:0}: Error finding container 5f346dec909ae57ee66d7967e9811e93b5df08f4b3d4a97ce73a6278a15991ec: Status 404 returned error can't find the container with id 5f346dec909ae57ee66d7967e9811e93b5df08f4b3d4a97ce73a6278a15991ec Jul 08 17:28:35.432034 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:35.431988 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75f7f" podUID="816897cd-daa9-4f85-a3eb-df37895420a8" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.41:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 17:28:35.604020 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:35.603984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" event={"ID":"01e56429-cdba-4d68-8686-a612b2d2b28c","Type":"ContainerStarted","Data":"7536ad19656f7af6803fecf831a7f080e7dca0f5fce2f54657c511b4aaf9d02f"} Jul 08 17:28:35.604191 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:35.604034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" event={"ID":"01e56429-cdba-4d68-8686-a612b2d2b28c","Type":"ContainerStarted","Data":"5f346dec909ae57ee66d7967e9811e93b5df08f4b3d4a97ce73a6278a15991ec"} Jul 08 17:28:35.604191 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:35.604064 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:36.012126 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:36.012094 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816897cd-daa9-4f85-a3eb-df37895420a8" path="/var/lib/kubelet/pods/816897cd-daa9-4f85-a3eb-df37895420a8/volumes" Jul 08 17:28:46.613461 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:46.613433 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:28:46.640441 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:46.640388 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" podStartSLOduration=12.640372629 podStartE2EDuration="12.640372629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:35.628049229 +0000 UTC m=+566.087261761" watchObservedRunningTime="2026-07-08 17:28:46.640372629 +0000 UTC m=+577.099585161" Jul 08 17:28:50.676890 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.676837 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn"] Jul 08 17:28:50.680650 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.680630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.689399 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.689383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4v6f5\"" Jul 08 17:28:50.700598 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.700566 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn"] Jul 08 17:28:50.722316 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.722289 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:50.768735 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.768708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.768952 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.768748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44ce844d-7409-460e-ac30-3901a2e83f86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.768952 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.768767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44ce844d-7409-460e-ac30-3901a2e83f86-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.768952 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.768785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nbwn\" (UniqueName: \"kubernetes.io/projected/44ce844d-7409-460e-ac30-3901a2e83f86-kube-api-access-9nbwn\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.768952 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.768802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44ce844d-7409-460e-ac30-3901a2e83f86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.768952 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.768871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.768952 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.768932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.769183 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.768991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.769183 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.769023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.869995 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.869960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.869995 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.869999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44ce844d-7409-460e-ac30-3901a2e83f86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870198 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44ce844d-7409-460e-ac30-3901a2e83f86-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870198 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nbwn\" (UniqueName: \"kubernetes.io/projected/44ce844d-7409-460e-ac30-3901a2e83f86-kube-api-access-9nbwn\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870198 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44ce844d-7409-460e-ac30-3901a2e83f86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870323 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870323 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870323 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870533 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870533 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870727 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870701 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870822 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870741 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870822 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870799 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.870995 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.870978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44ce844d-7409-460e-ac30-3901a2e83f86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.872463 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.872441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44ce844d-7409-460e-ac30-3901a2e83f86-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.872610 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.872590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44ce844d-7409-460e-ac30-3901a2e83f86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.878039 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.878015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44ce844d-7409-460e-ac30-3901a2e83f86-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.878185 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.878165 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nbwn\" (UniqueName: \"kubernetes.io/projected/44ce844d-7409-460e-ac30-3901a2e83f86-kube-api-access-9nbwn\") pod \"maas-default-gateway-openshift-default-56654dcf7-lvmvn\" (UID: \"44ce844d-7409-460e-ac30-3901a2e83f86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:50.991669 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:50.991575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:51.143544 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.143519 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn"] Jul 08 17:28:51.145468 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:28:51.145441 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ce844d_7409_460e_ac30_3901a2e83f86.slice/crio-d7cd2325cbf806bd9ccc6225153124e0415f6a6f425b14496dd259510786584f WatchSource:0}: Error finding container d7cd2325cbf806bd9ccc6225153124e0415f6a6f425b14496dd259510786584f: Status 404 returned error can't find the container with id d7cd2325cbf806bd9ccc6225153124e0415f6a6f425b14496dd259510786584f Jul 08 17:28:51.147881 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.147838 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:28:51.147994 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.147929 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:28:51.147994 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.147976 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:28:51.174298 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.174267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:51.690272 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.690240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" event={"ID":"44ce844d-7409-460e-ac30-3901a2e83f86","Type":"ContainerStarted","Data":"e319eb852d158f1f743ed92385b4f4799a886f4d37c6861e399b2756dc887afd"} Jul 08 17:28:51.690684 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.690294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" event={"ID":"44ce844d-7409-460e-ac30-3901a2e83f86","Type":"ContainerStarted","Data":"d7cd2325cbf806bd9ccc6225153124e0415f6a6f425b14496dd259510786584f"} Jul 08 17:28:51.711803 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.711750 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" podStartSLOduration=1.711733559 podStartE2EDuration="1.711733559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:51.709634358 +0000 UTC m=+582.168846900" watchObservedRunningTime="2026-07-08 17:28:51.711733559 +0000 UTC m=+582.170946091" Jul 08 17:28:51.992597 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:51.992503 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:52.712624 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:52.712589 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:52.812902 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:52.812839 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:52.867967 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:52.867930 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:52.997364 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:52.997275 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:53.520008 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.519978 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-dcmr5"] Jul 08 17:28:53.523641 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.523608 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dcmr5" Jul 08 17:28:53.526105 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.526079 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4nk7v\"" Jul 08 17:28:53.531485 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.531326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dcmr5"] Jul 08 17:28:53.569520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.569481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:53.673622 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.673578 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:28:53.695398 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.695366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w7jz\" (UniqueName: \"kubernetes.io/projected/45002125-d149-4ce0-9d6c-cc4ce738ab69-kube-api-access-5w7jz\") pod \"authorino-58cd955675-dcmr5\" (UID: \"45002125-d149-4ce0-9d6c-cc4ce738ab69\") " pod="kuadrant-system/authorino-58cd955675-dcmr5" Jul 08 17:28:53.700322 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.700307 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:53.701235 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.701214 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:28:53.796674 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.796593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w7jz\" (UniqueName: \"kubernetes.io/projected/45002125-d149-4ce0-9d6c-cc4ce738ab69-kube-api-access-5w7jz\") pod \"authorino-58cd955675-dcmr5\" (UID: \"45002125-d149-4ce0-9d6c-cc4ce738ab69\") " pod="kuadrant-system/authorino-58cd955675-dcmr5" Jul 08 17:28:53.804343 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.804320 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w7jz\" (UniqueName: \"kubernetes.io/projected/45002125-d149-4ce0-9d6c-cc4ce738ab69-kube-api-access-5w7jz\") pod \"authorino-58cd955675-dcmr5\" (UID: \"45002125-d149-4ce0-9d6c-cc4ce738ab69\") " pod="kuadrant-system/authorino-58cd955675-dcmr5" Jul 08 17:28:53.834224 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.834193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dcmr5" Jul 08 17:28:53.964356 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:53.964314 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dcmr5"] Jul 08 17:28:53.970884 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:28:53.970837 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45002125_d149_4ce0_9d6c_cc4ce738ab69.slice/crio-eb0ab5003a9851a2f1e79f331747a547af153befc74179eeef4529d51ee386cd WatchSource:0}: Error finding container eb0ab5003a9851a2f1e79f331747a547af153befc74179eeef4529d51ee386cd: Status 404 returned error can't find the container with id eb0ab5003a9851a2f1e79f331747a547af153befc74179eeef4529d51ee386cd Jul 08 17:28:54.707804 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:54.707767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dcmr5" event={"ID":"45002125-d149-4ce0-9d6c-cc4ce738ab69","Type":"ContainerStarted","Data":"eb0ab5003a9851a2f1e79f331747a547af153befc74179eeef4529d51ee386cd"} Jul 08 17:28:58.733466 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:58.733430 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dcmr5" event={"ID":"45002125-d149-4ce0-9d6c-cc4ce738ab69","Type":"ContainerStarted","Data":"1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c"} Jul 08 17:28:58.749610 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:58.749559 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-dcmr5" podStartSLOduration=2.020395579 podStartE2EDuration="5.749544355s" totalImagesPullingTime="3.729148776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:58.748467674 +0000 UTC m=+589.207680207" watchObservedRunningTime="2026-07-08 17:28:58.749544355 +0000 UTC m=+589.208756886" Jul 08 17:28:59.424343 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:28:59.424310 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dcmr5"] Jul 08 17:29:00.743727 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:00.743688 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-dcmr5" podUID="45002125-d149-4ce0-9d6c-cc4ce738ab69" containerName="authorino" containerID="cri-o://1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c" gracePeriod=30 Jul 08 17:29:00.998357 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:00.998287 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dcmr5" Jul 08 17:29:01.157956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.157919 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w7jz\" (UniqueName: \"kubernetes.io/projected/45002125-d149-4ce0-9d6c-cc4ce738ab69-kube-api-access-5w7jz\") pod \"45002125-d149-4ce0-9d6c-cc4ce738ab69\" (UID: \"45002125-d149-4ce0-9d6c-cc4ce738ab69\") " Jul 08 17:29:01.160019 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.159985 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45002125-d149-4ce0-9d6c-cc4ce738ab69-kube-api-access-5w7jz" (OuterVolumeSpecName: "kube-api-access-5w7jz") pod "45002125-d149-4ce0-9d6c-cc4ce738ab69" (UID: "45002125-d149-4ce0-9d6c-cc4ce738ab69"). InnerVolumeSpecName "kube-api-access-5w7jz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:29:01.259546 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.259467 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w7jz\" (UniqueName: \"kubernetes.io/projected/45002125-d149-4ce0-9d6c-cc4ce738ab69-kube-api-access-5w7jz\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:29:01.750111 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.750072 2578 generic.go:356] "Generic (PLEG): container finished" podID="45002125-d149-4ce0-9d6c-cc4ce738ab69" containerID="1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c" exitCode=0 Jul 08 17:29:01.750528 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.750120 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dcmr5" Jul 08 17:29:01.750528 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.750125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dcmr5" event={"ID":"45002125-d149-4ce0-9d6c-cc4ce738ab69","Type":"ContainerDied","Data":"1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c"} Jul 08 17:29:01.750528 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.750164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dcmr5" event={"ID":"45002125-d149-4ce0-9d6c-cc4ce738ab69","Type":"ContainerDied","Data":"eb0ab5003a9851a2f1e79f331747a547af153befc74179eeef4529d51ee386cd"} Jul 08 17:29:01.750528 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.750186 2578 scope.go:117] "RemoveContainer" containerID="1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c" Jul 08 17:29:01.761774 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.761753 2578 scope.go:117] "RemoveContainer" containerID="1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c" Jul 08 17:29:01.762323 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:29:01.762297 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c\": container with ID starting with 1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c not found: ID does not exist" containerID="1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c" Jul 08 17:29:01.762435 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.762326 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c"} err="failed to get container status \"1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c\": rpc error: code = NotFound desc = could not find container \"1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c\": container with ID starting with 1bebbb8b737020866ea5c9ce2dca846ca1d2610bc8817bfad664fd29e98e297c not found: ID does not exist" Jul 08 17:29:01.771197 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.771177 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dcmr5"] Jul 08 17:29:01.775328 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:01.775306 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-dcmr5"] Jul 08 17:29:02.012104 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:02.012010 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45002125-d149-4ce0-9d6c-cc4ce738ab69" path="/var/lib/kubelet/pods/45002125-d149-4ce0-9d6c-cc4ce738ab69/volumes" Jul 08 17:29:09.952395 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:09.952366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:29:09.952888 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:09.952372 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:29:13.995515 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:13.995481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:14.113037 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:14.113005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:14.568450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:14.568410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:26.848464 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:26.848432 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:27.074709 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.074640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:27.077003 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.076983 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gt7bh"] Jul 08 17:29:27.077335 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.077324 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45002125-d149-4ce0-9d6c-cc4ce738ab69" containerName="authorino" Jul 08 17:29:27.077375 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.077337 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="45002125-d149-4ce0-9d6c-cc4ce738ab69" containerName="authorino" Jul 08 17:29:27.077410 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.077394 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="45002125-d149-4ce0-9d6c-cc4ce738ab69" containerName="authorino" Jul 08 17:29:27.082797 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.082773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" Jul 08 17:29:27.085466 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.085440 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gt7bh"] Jul 08 17:29:27.085833 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.085802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4nk7v\"" Jul 08 17:29:27.157233 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.157199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-422wv\" (UniqueName: \"kubernetes.io/projected/87f2488d-5341-441a-b8a3-620ebf862858-kube-api-access-422wv\") pod \"authorino-5d4b67c446-gt7bh\" (UID: \"87f2488d-5341-441a-b8a3-620ebf862858\") " pod="kuadrant-system/authorino-5d4b67c446-gt7bh" Jul 08 17:29:27.257613 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.257581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-422wv\" (UniqueName: \"kubernetes.io/projected/87f2488d-5341-441a-b8a3-620ebf862858-kube-api-access-422wv\") pod \"authorino-5d4b67c446-gt7bh\" (UID: \"87f2488d-5341-441a-b8a3-620ebf862858\") " pod="kuadrant-system/authorino-5d4b67c446-gt7bh" Jul 08 17:29:27.266313 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.266280 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-422wv\" (UniqueName: \"kubernetes.io/projected/87f2488d-5341-441a-b8a3-620ebf862858-kube-api-access-422wv\") pod \"authorino-5d4b67c446-gt7bh\" (UID: \"87f2488d-5341-441a-b8a3-620ebf862858\") " pod="kuadrant-system/authorino-5d4b67c446-gt7bh" Jul 08 17:29:27.316543 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.316513 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gt7bh"] Jul 08 17:29:27.316778 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.316767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" Jul 08 17:29:27.339454 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.339430 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59b6549848-4f62s"] Jul 08 17:29:27.342401 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.342382 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b6549848-4f62s" Jul 08 17:29:27.352899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.352870 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59b6549848-4f62s"] Jul 08 17:29:27.358524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.358498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkj8j\" (UniqueName: \"kubernetes.io/projected/6277db87-2831-4e19-905d-5a9176c39427-kube-api-access-jkj8j\") pod \"authorino-59b6549848-4f62s\" (UID: \"6277db87-2831-4e19-905d-5a9176c39427\") " pod="kuadrant-system/authorino-59b6549848-4f62s" Jul 08 17:29:27.449875 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.449825 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gt7bh"] Jul 08 17:29:27.452024 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:29:27.451996 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87f2488d_5341_441a_b8a3_620ebf862858.slice/crio-7db49ec4656af6144a53ebdc48d5800d18851d18415c6c422b936cddf4f7cd37 WatchSource:0}: Error finding container 7db49ec4656af6144a53ebdc48d5800d18851d18415c6c422b936cddf4f7cd37: Status 404 returned error can't find the container with id 7db49ec4656af6144a53ebdc48d5800d18851d18415c6c422b936cddf4f7cd37 Jul 08 17:29:27.459738 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.459714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkj8j\" (UniqueName: \"kubernetes.io/projected/6277db87-2831-4e19-905d-5a9176c39427-kube-api-access-jkj8j\") pod \"authorino-59b6549848-4f62s\" (UID: \"6277db87-2831-4e19-905d-5a9176c39427\") " pod="kuadrant-system/authorino-59b6549848-4f62s" Jul 08 17:29:27.467327 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.467302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkj8j\" (UniqueName: \"kubernetes.io/projected/6277db87-2831-4e19-905d-5a9176c39427-kube-api-access-jkj8j\") pod \"authorino-59b6549848-4f62s\" (UID: \"6277db87-2831-4e19-905d-5a9176c39427\") " pod="kuadrant-system/authorino-59b6549848-4f62s" Jul 08 17:29:27.523151 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.523116 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59b6549848-4f62s"] Jul 08 17:29:27.523385 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.523374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b6549848-4f62s" Jul 08 17:29:27.550847 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.550819 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5589bc6f9b-bm6sq"] Jul 08 17:29:27.554184 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.554156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:29:27.556708 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.556688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 17:29:27.563552 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.563525 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5589bc6f9b-bm6sq"] Jul 08 17:29:27.659933 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.659913 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59b6549848-4f62s"] Jul 08 17:29:27.660915 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.660897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfdf5610-a7cd-4058-918c-5cde8163c7d3-tls-cert\") pod \"authorino-5589bc6f9b-bm6sq\" (UID: \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\") " pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:29:27.660967 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.660924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhwrd\" (UniqueName: \"kubernetes.io/projected/dfdf5610-a7cd-4058-918c-5cde8163c7d3-kube-api-access-qhwrd\") pod \"authorino-5589bc6f9b-bm6sq\" (UID: \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\") " pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:29:27.662369 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:29:27.662352 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6277db87_2831_4e19_905d_5a9176c39427.slice/crio-22d9499704783fb3193ef2555362526824bca7fd5d0660750bdcaa18203a206c WatchSource:0}: Error finding container 22d9499704783fb3193ef2555362526824bca7fd5d0660750bdcaa18203a206c: Status 404 returned error can't find the container with id 22d9499704783fb3193ef2555362526824bca7fd5d0660750bdcaa18203a206c Jul 08 17:29:27.762210 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.762123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfdf5610-a7cd-4058-918c-5cde8163c7d3-tls-cert\") pod \"authorino-5589bc6f9b-bm6sq\" (UID: \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\") " pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:29:27.762210 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.762159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhwrd\" (UniqueName: \"kubernetes.io/projected/dfdf5610-a7cd-4058-918c-5cde8163c7d3-kube-api-access-qhwrd\") pod \"authorino-5589bc6f9b-bm6sq\" (UID: \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\") " pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:29:27.764494 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.764472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfdf5610-a7cd-4058-918c-5cde8163c7d3-tls-cert\") pod \"authorino-5589bc6f9b-bm6sq\" (UID: \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\") " pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:29:27.770424 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.770402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhwrd\" (UniqueName: \"kubernetes.io/projected/dfdf5610-a7cd-4058-918c-5cde8163c7d3-kube-api-access-qhwrd\") pod \"authorino-5589bc6f9b-bm6sq\" (UID: \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\") " pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:29:27.865133 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.865091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:29:27.894799 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.894768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b6549848-4f62s" event={"ID":"6277db87-2831-4e19-905d-5a9176c39427","Type":"ContainerStarted","Data":"22d9499704783fb3193ef2555362526824bca7fd5d0660750bdcaa18203a206c"} Jul 08 17:29:27.896031 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:27.896006 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" event={"ID":"87f2488d-5341-441a-b8a3-620ebf862858","Type":"ContainerStarted","Data":"7db49ec4656af6144a53ebdc48d5800d18851d18415c6c422b936cddf4f7cd37"} Jul 08 17:29:28.001025 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.000998 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5589bc6f9b-bm6sq"] Jul 08 17:29:28.002656 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:29:28.002628 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfdf5610_a7cd_4058_918c_5cde8163c7d3.slice/crio-79d153b84b9553643a657a5525f3fabd9e5be14fd117910ace7b10d1f660db2f WatchSource:0}: Error finding container 79d153b84b9553643a657a5525f3fabd9e5be14fd117910ace7b10d1f660db2f: Status 404 returned error can't find the container with id 79d153b84b9553643a657a5525f3fabd9e5be14fd117910ace7b10d1f660db2f Jul 08 17:29:28.902935 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.902898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" event={"ID":"dfdf5610-a7cd-4058-918c-5cde8163c7d3","Type":"ContainerStarted","Data":"fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6"} Jul 08 17:29:28.903379 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.902943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" event={"ID":"dfdf5610-a7cd-4058-918c-5cde8163c7d3","Type":"ContainerStarted","Data":"79d153b84b9553643a657a5525f3fabd9e5be14fd117910ace7b10d1f660db2f"} Jul 08 17:29:28.904426 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.904401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b6549848-4f62s" event={"ID":"6277db87-2831-4e19-905d-5a9176c39427","Type":"ContainerStarted","Data":"0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae"} Jul 08 17:29:28.904534 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.904431 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-59b6549848-4f62s" podUID="6277db87-2831-4e19-905d-5a9176c39427" containerName="authorino" containerID="cri-o://0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae" gracePeriod=30 Jul 08 17:29:28.905798 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.905780 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" event={"ID":"87f2488d-5341-441a-b8a3-620ebf862858","Type":"ContainerStarted","Data":"6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1"} Jul 08 17:29:28.905901 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.905799 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" podUID="87f2488d-5341-441a-b8a3-620ebf862858" containerName="authorino" containerID="cri-o://6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1" gracePeriod=30 Jul 08 17:29:28.922922 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.922875 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" podStartSLOduration=1.5183961259999998 podStartE2EDuration="1.922839913s" totalImagesPullingTime="404.443787ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:28.921924244 +0000 UTC m=+619.381136777" watchObservedRunningTime="2026-07-08 17:29:28.922839913 +0000 UTC m=+619.382052423" Jul 08 17:29:28.944520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.944467 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" podStartSLOduration=1.437123885 podStartE2EDuration="1.9444497s" totalImagesPullingTime="507.325815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:28.943668334 +0000 UTC m=+619.402880864" watchObservedRunningTime="2026-07-08 17:29:28.9444497 +0000 UTC m=+619.403662232" Jul 08 17:29:28.967208 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:28.967160 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59b6549848-4f62s" podStartSLOduration=1.610046514 podStartE2EDuration="1.967144906s" totalImagesPullingTime="357.098392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:28.964962452 +0000 UTC m=+619.424174982" watchObservedRunningTime="2026-07-08 17:29:28.967144906 +0000 UTC m=+619.426357437" Jul 08 17:29:29.177764 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.177740 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" Jul 08 17:29:29.182025 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.181997 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b6549848-4f62s" Jul 08 17:29:29.274781 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.274749 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-422wv\" (UniqueName: \"kubernetes.io/projected/87f2488d-5341-441a-b8a3-620ebf862858-kube-api-access-422wv\") pod \"87f2488d-5341-441a-b8a3-620ebf862858\" (UID: \"87f2488d-5341-441a-b8a3-620ebf862858\") " Jul 08 17:29:29.274934 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.274821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkj8j\" (UniqueName: \"kubernetes.io/projected/6277db87-2831-4e19-905d-5a9176c39427-kube-api-access-jkj8j\") pod \"6277db87-2831-4e19-905d-5a9176c39427\" (UID: \"6277db87-2831-4e19-905d-5a9176c39427\") " Jul 08 17:29:29.276952 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.276921 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f2488d-5341-441a-b8a3-620ebf862858-kube-api-access-422wv" (OuterVolumeSpecName: "kube-api-access-422wv") pod "87f2488d-5341-441a-b8a3-620ebf862858" (UID: "87f2488d-5341-441a-b8a3-620ebf862858"). InnerVolumeSpecName "kube-api-access-422wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:29:29.277101 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.277077 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6277db87-2831-4e19-905d-5a9176c39427-kube-api-access-jkj8j" (OuterVolumeSpecName: "kube-api-access-jkj8j") pod "6277db87-2831-4e19-905d-5a9176c39427" (UID: "6277db87-2831-4e19-905d-5a9176c39427"). InnerVolumeSpecName "kube-api-access-jkj8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:29:29.376056 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.376019 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-422wv\" (UniqueName: \"kubernetes.io/projected/87f2488d-5341-441a-b8a3-620ebf862858-kube-api-access-422wv\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:29:29.376056 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.376049 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkj8j\" (UniqueName: \"kubernetes.io/projected/6277db87-2831-4e19-905d-5a9176c39427-kube-api-access-jkj8j\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:29:29.912605 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.912565 2578 generic.go:356] "Generic (PLEG): container finished" podID="6277db87-2831-4e19-905d-5a9176c39427" containerID="0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae" exitCode=0 Jul 08 17:29:29.912605 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.912610 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59b6549848-4f62s" Jul 08 17:29:29.913143 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.912656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b6549848-4f62s" event={"ID":"6277db87-2831-4e19-905d-5a9176c39427","Type":"ContainerDied","Data":"0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae"} Jul 08 17:29:29.913143 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.912708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59b6549848-4f62s" event={"ID":"6277db87-2831-4e19-905d-5a9176c39427","Type":"ContainerDied","Data":"22d9499704783fb3193ef2555362526824bca7fd5d0660750bdcaa18203a206c"} Jul 08 17:29:29.913143 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.912733 2578 scope.go:117] "RemoveContainer" containerID="0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae" Jul 08 17:29:29.914143 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.913960 2578 generic.go:356] "Generic (PLEG): container finished" podID="87f2488d-5341-441a-b8a3-620ebf862858" containerID="6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1" exitCode=0 Jul 08 17:29:29.914143 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.914006 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" Jul 08 17:29:29.914143 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.914040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" event={"ID":"87f2488d-5341-441a-b8a3-620ebf862858","Type":"ContainerDied","Data":"6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1"} Jul 08 17:29:29.914143 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.914090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gt7bh" event={"ID":"87f2488d-5341-441a-b8a3-620ebf862858","Type":"ContainerDied","Data":"7db49ec4656af6144a53ebdc48d5800d18851d18415c6c422b936cddf4f7cd37"} Jul 08 17:29:29.923473 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.923456 2578 scope.go:117] "RemoveContainer" containerID="0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae" Jul 08 17:29:29.923758 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:29:29.923738 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae\": container with ID starting with 0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae not found: ID does not exist" containerID="0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae" Jul 08 17:29:29.923841 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.923768 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae"} err="failed to get container status \"0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae\": rpc error: code = NotFound desc = could not find container \"0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae\": container with ID starting with 0f103875929a92d4430492a5cb494521050f17591891e36e80fab937ed2d43ae not found: ID does not exist" Jul 08 17:29:29.923841 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.923791 2578 scope.go:117] "RemoveContainer" containerID="6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1" Jul 08 17:29:29.931941 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.931919 2578 scope.go:117] "RemoveContainer" containerID="6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1" Jul 08 17:29:29.932175 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:29:29.932158 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1\": container with ID starting with 6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1 not found: ID does not exist" containerID="6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1" Jul 08 17:29:29.932229 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.932182 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1"} err="failed to get container status \"6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1\": rpc error: code = NotFound desc = could not find container \"6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1\": container with ID starting with 6f3570b38d1dbce75cf65bf032d62e7bc42820736aa579a1dd2705662b5f44c1 not found: ID does not exist" Jul 08 17:29:29.939202 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.939182 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59b6549848-4f62s"] Jul 08 17:29:29.947321 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.947301 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59b6549848-4f62s"] Jul 08 17:29:29.958794 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.958763 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gt7bh"] Jul 08 17:29:29.962892 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:29.962840 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gt7bh"] Jul 08 17:29:30.012456 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:30.012426 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6277db87-2831-4e19-905d-5a9176c39427" path="/var/lib/kubelet/pods/6277db87-2831-4e19-905d-5a9176c39427/volumes" Jul 08 17:29:30.012748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:30.012736 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f2488d-5341-441a-b8a3-620ebf862858" path="/var/lib/kubelet/pods/87f2488d-5341-441a-b8a3-620ebf862858/volumes" Jul 08 17:29:33.432433 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:33.432352 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:34.904776 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:34.904740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:37.227586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:37.227538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:37.322947 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:37.322912 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:29:43.854488 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:29:43.854455 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:08.746038 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:08.745999 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:08.831492 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:08.831455 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:09.210251 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:09.210221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:09.580286 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:09.580189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:09.768976 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:09.768936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:09.874676 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:09.874573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:18.177221 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:18.177192 2578 generic.go:356] "Generic (PLEG): container finished" podID="44ce844d-7409-460e-ac30-3901a2e83f86" containerID="e319eb852d158f1f743ed92385b4f4799a886f4d37c6861e399b2756dc887afd" exitCode=0 Jul 08 17:30:18.177640 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:18.177269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" event={"ID":"44ce844d-7409-460e-ac30-3901a2e83f86","Type":"ContainerDied","Data":"e319eb852d158f1f743ed92385b4f4799a886f4d37c6861e399b2756dc887afd"} Jul 08 17:30:18.177683 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:18.177675 2578 scope.go:117] "RemoveContainer" containerID="e319eb852d158f1f743ed92385b4f4799a886f4d37c6861e399b2756dc887afd" Jul 08 17:30:18.178686 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:18.178660 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:30:18.178759 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:18.178741 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:30:18.178796 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:18.178787 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:30:19.184182 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:19.184151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" event={"ID":"44ce844d-7409-460e-ac30-3901a2e83f86","Type":"ContainerStarted","Data":"fe208e47962c9487342683a4ab3b7e6805f1ccc62e43aa2602d3ed66f245c1eb"} Jul 08 17:30:19.992097 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:19.992068 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:30:19.993306 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:19.993284 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lvmvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 17:30:19.993366 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:19.993334 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" podUID="44ce844d-7409-460e-ac30-3901a2e83f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 17:30:20.273328 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:20.273218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:20.374466 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:20.374415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:20.993037 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:20.993000 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lvmvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 17:30:20.993222 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:20.993068 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" podUID="44ce844d-7409-460e-ac30-3901a2e83f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 17:30:21.992723 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:21.992681 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-lvmvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 17:30:21.993131 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:21.992749 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" podUID="44ce844d-7409-460e-ac30-3901a2e83f86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 17:30:23.044252 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:23.044221 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:30:23.044707 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:23.044631 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:30:23.045465 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:23.045443 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-lvmvn" Jul 08 17:30:32.927382 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:32.927342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:39.496956 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.496919 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst"] Jul 08 17:30:39.497450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.497313 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f2488d-5341-441a-b8a3-620ebf862858" containerName="authorino" Jul 08 17:30:39.497450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.497324 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f2488d-5341-441a-b8a3-620ebf862858" containerName="authorino" Jul 08 17:30:39.497450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.497333 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6277db87-2831-4e19-905d-5a9176c39427" containerName="authorino" Jul 08 17:30:39.497450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.497339 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6277db87-2831-4e19-905d-5a9176c39427" containerName="authorino" Jul 08 17:30:39.497450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.497394 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6277db87-2831-4e19-905d-5a9176c39427" containerName="authorino" Jul 08 17:30:39.497450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.497403 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f2488d-5341-441a-b8a3-620ebf862858" containerName="authorino" Jul 08 17:30:39.499319 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.499301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.503129 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.503100 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 17:30:39.503272 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.503175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hkglw\"" Jul 08 17:30:39.503272 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.503185 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 17:30:39.503272 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.503175 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 17:30:39.511955 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.511932 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst"] Jul 08 17:30:39.529743 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.529704 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:39.624190 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.624154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzmv8\" (UniqueName: \"kubernetes.io/projected/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-kube-api-access-lzmv8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.624397 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.624203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.624397 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.624221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.624397 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.624320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.624397 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.624368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.624584 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.624403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.725641 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.725606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.725895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.725651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.725895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.725672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.725895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.725721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmv8\" (UniqueName: \"kubernetes.io/projected/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-kube-api-access-lzmv8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.725895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.725747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.725895 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.725763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.726194 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.726173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.726260 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.726228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.726260 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.726255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.728008 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.727988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.728259 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.728240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.737379 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.737355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzmv8\" (UniqueName: \"kubernetes.io/projected/aa219f5b-49c4-4179-b0ac-6b8d391a1d88-kube-api-access-lzmv8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-n4kst\" (UID: \"aa219f5b-49c4-4179-b0ac-6b8d391a1d88\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.810497 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.810402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:39.950133 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.950101 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst"] Jul 08 17:30:39.951158 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:30:39.951135 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa219f5b_49c4_4179_b0ac_6b8d391a1d88.slice/crio-b35c19a316dfe3aa3d6a99daf7e2e755529123436e61c4eab53de52a7233f27b WatchSource:0}: Error finding container b35c19a316dfe3aa3d6a99daf7e2e755529123436e61c4eab53de52a7233f27b: Status 404 returned error can't find the container with id b35c19a316dfe3aa3d6a99daf7e2e755529123436e61c4eab53de52a7233f27b Jul 08 17:30:39.952517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:39.952500 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:30:40.310213 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:40.310178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" event={"ID":"aa219f5b-49c4-4179-b0ac-6b8d391a1d88","Type":"ContainerStarted","Data":"b35c19a316dfe3aa3d6a99daf7e2e755529123436e61c4eab53de52a7233f27b"} Jul 08 17:30:41.317716 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:41.317683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" event={"ID":"aa219f5b-49c4-4179-b0ac-6b8d391a1d88","Type":"ContainerStarted","Data":"943a5b7cdfe2a945139c741d2135a6186105775027de9b8199f44cc67e2e805f"} Jul 08 17:30:41.341581 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:41.341471 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" podStartSLOduration=1.207075682 podStartE2EDuration="2.341453159s" totalImagesPullingTime="1.134377477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:30:41.340349409 +0000 UTC m=+691.799561941" watchObservedRunningTime="2026-07-08 17:30:41.341453159 +0000 UTC m=+691.800665690" Jul 08 17:30:49.810767 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:49.810717 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:49.810767 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:49.810786 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:49.825964 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:49.825934 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:50.380543 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:50.380512 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-n4kst" Jul 08 17:30:54.119643 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:54.119605 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:30:58.387570 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:30:58.387527 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:31:02.793293 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.793193 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-98465"] Jul 08 17:31:02.796149 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.796132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.798899 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.798879 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 17:31:02.805918 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.805894 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-98465"] Jul 08 17:31:02.842669 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.842633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.842846 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.842715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.842846 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.842752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.842846 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.842777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.842846 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.842819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.842846 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.842839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zldm8\" (UniqueName: \"kubernetes.io/projected/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-kube-api-access-zldm8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944324 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944517 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zldm8\" (UniqueName: \"kubernetes.io/projected/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-kube-api-access-zldm8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944791 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944842 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944807 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.944980 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.944944 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.946588 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.946570 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.946772 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.946752 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:02.953766 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.953734 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:31:02.956632 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:02.956610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zldm8\" (UniqueName: \"kubernetes.io/projected/8e164e3e-1e0c-4c18-a9a6-678eac4e5226-kube-api-access-zldm8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-98465\" (UID: \"8e164e3e-1e0c-4c18-a9a6-678eac4e5226\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:03.108033 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:03.107937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:03.247585 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:03.247556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-98465"] Jul 08 17:31:03.249183 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:31:03.249156 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e164e3e_1e0c_4c18_a9a6_678eac4e5226.slice/crio-a7701fde811a89c1a2629888f18e3ee3d8e92746ec08582d146c3a23ad45fc85 WatchSource:0}: Error finding container a7701fde811a89c1a2629888f18e3ee3d8e92746ec08582d146c3a23ad45fc85: Status 404 returned error can't find the container with id a7701fde811a89c1a2629888f18e3ee3d8e92746ec08582d146c3a23ad45fc85 Jul 08 17:31:03.445463 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:03.445427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" event={"ID":"8e164e3e-1e0c-4c18-a9a6-678eac4e5226","Type":"ContainerStarted","Data":"a7701fde811a89c1a2629888f18e3ee3d8e92746ec08582d146c3a23ad45fc85"} Jul 08 17:31:04.452148 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:04.452111 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" event={"ID":"8e164e3e-1e0c-4c18-a9a6-678eac4e5226","Type":"ContainerStarted","Data":"63a01439fb2fecbff6a1c64c0943de29ba4f2394db5fc1e8be23f04a77e70e94"} Jul 08 17:31:04.471912 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:04.471830 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" podStartSLOduration=2.265531959 podStartE2EDuration="2.47180838s" totalImagesPullingTime="206.276421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:31:04.468003648 +0000 UTC m=+714.927216181" watchObservedRunningTime="2026-07-08 17:31:04.47180838 +0000 UTC m=+714.931020914" Jul 08 17:31:13.108346 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:13.108302 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:13.108844 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:13.108386 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:13.120990 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:13.120964 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:13.515977 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:13.515952 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-98465" Jul 08 17:31:13.594292 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:13.594261 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:31:22.039721 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:22.039679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:31:22.331757 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:22.331667 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:31:26.294707 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.294670 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm"] Jul 08 17:31:26.300842 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.300818 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.303525 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.303501 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 17:31:26.309286 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.309265 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm"] Jul 08 17:31:26.331889 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.331829 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:31:26.459784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.459745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.459998 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.459788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blnx6\" (UniqueName: \"kubernetes.io/projected/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-kube-api-access-blnx6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.459998 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.459848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.460102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.459991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.460102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.460023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.460102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.460043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561075 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.560987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561075 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.561025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561075 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.561044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561297 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.561164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561297 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.561194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blnx6\" (UniqueName: \"kubernetes.io/projected/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-kube-api-access-blnx6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561297 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.561236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561420 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.561400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561457 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.561442 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.561501 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.561482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.563358 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.563339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.563622 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.563604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.569157 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.569135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blnx6\" (UniqueName: \"kubernetes.io/projected/3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3-kube-api-access-blnx6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm\" (UID: \"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.611001 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.610975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:26.753394 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:26.753368 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm"] Jul 08 17:31:26.755943 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:31:26.755904 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a371b8a_5e2d_4f5c_9a7a_8e7d087f73f3.slice/crio-647e13956823712087fb07e41077e5b296274ed8ef6065bb4eeb7b2a5a1f7102 WatchSource:0}: Error finding container 647e13956823712087fb07e41077e5b296274ed8ef6065bb4eeb7b2a5a1f7102: Status 404 returned error can't find the container with id 647e13956823712087fb07e41077e5b296274ed8ef6065bb4eeb7b2a5a1f7102 Jul 08 17:31:27.586380 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:27.586348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" event={"ID":"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3","Type":"ContainerStarted","Data":"19af055b74e3ab66a83f06b017a9ba156956ae02b7ff40b820b462aaabd5dbc2"} Jul 08 17:31:27.586380 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:27.586388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" event={"ID":"3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3","Type":"ContainerStarted","Data":"647e13956823712087fb07e41077e5b296274ed8ef6065bb4eeb7b2a5a1f7102"} Jul 08 17:31:27.607006 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:27.606957 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" podStartSLOduration=1.407950153 podStartE2EDuration="1.606941617s" totalImagesPullingTime="198.991464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:31:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:31:27.604646018 +0000 UTC m=+738.063858555" watchObservedRunningTime="2026-07-08 17:31:27.606941617 +0000 UTC m=+738.066154149" Jul 08 17:31:36.611809 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:36.611772 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:36.612298 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:36.611829 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:36.624632 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:36.624609 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:31:36.646906 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:31:36.646885 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm" Jul 08 17:32:17.553102 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:17.553066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:32:48.949190 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:48.949158 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c5bd444f-xbxps"] Jul 08 17:32:48.952711 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:48.952690 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c5bd444f-xbxps" Jul 08 17:32:48.987586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:48.987556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c5bd444f-xbxps"] Jul 08 17:32:49.118363 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.118329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0c200d1-e65c-4892-9973-f7c3cbdc49d6-tls-cert\") pod \"authorino-59c5bd444f-xbxps\" (UID: \"f0c200d1-e65c-4892-9973-f7c3cbdc49d6\") " pod="kuadrant-system/authorino-59c5bd444f-xbxps" Jul 08 17:32:49.118520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.118384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7m4p\" (UniqueName: \"kubernetes.io/projected/f0c200d1-e65c-4892-9973-f7c3cbdc49d6-kube-api-access-t7m4p\") pod \"authorino-59c5bd444f-xbxps\" (UID: \"f0c200d1-e65c-4892-9973-f7c3cbdc49d6\") " pod="kuadrant-system/authorino-59c5bd444f-xbxps" Jul 08 17:32:49.219636 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.219560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7m4p\" (UniqueName: \"kubernetes.io/projected/f0c200d1-e65c-4892-9973-f7c3cbdc49d6-kube-api-access-t7m4p\") pod \"authorino-59c5bd444f-xbxps\" (UID: \"f0c200d1-e65c-4892-9973-f7c3cbdc49d6\") " pod="kuadrant-system/authorino-59c5bd444f-xbxps" Jul 08 17:32:49.219799 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.219639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0c200d1-e65c-4892-9973-f7c3cbdc49d6-tls-cert\") pod \"authorino-59c5bd444f-xbxps\" (UID: \"f0c200d1-e65c-4892-9973-f7c3cbdc49d6\") " pod="kuadrant-system/authorino-59c5bd444f-xbxps" Jul 08 17:32:49.221958 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.221940 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0c200d1-e65c-4892-9973-f7c3cbdc49d6-tls-cert\") pod \"authorino-59c5bd444f-xbxps\" (UID: \"f0c200d1-e65c-4892-9973-f7c3cbdc49d6\") " pod="kuadrant-system/authorino-59c5bd444f-xbxps" Jul 08 17:32:49.250175 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.250148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7m4p\" (UniqueName: \"kubernetes.io/projected/f0c200d1-e65c-4892-9973-f7c3cbdc49d6-kube-api-access-t7m4p\") pod \"authorino-59c5bd444f-xbxps\" (UID: \"f0c200d1-e65c-4892-9973-f7c3cbdc49d6\") " pod="kuadrant-system/authorino-59c5bd444f-xbxps" Jul 08 17:32:49.261997 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.261967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c5bd444f-xbxps" Jul 08 17:32:49.294887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.294807 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:32:49.440084 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.440061 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c5bd444f-xbxps"] Jul 08 17:32:49.442227 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:32:49.442199 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0c200d1_e65c_4892_9973_f7c3cbdc49d6.slice/crio-854b6d0e20e20f3806c0a681e5093c9623abcfd8f44f73f0245772db8aa53a68 WatchSource:0}: Error finding container 854b6d0e20e20f3806c0a681e5093c9623abcfd8f44f73f0245772db8aa53a68: Status 404 returned error can't find the container with id 854b6d0e20e20f3806c0a681e5093c9623abcfd8f44f73f0245772db8aa53a68 Jul 08 17:32:49.495193 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:49.495115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:32:50.038759 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.038717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c5bd444f-xbxps" event={"ID":"f0c200d1-e65c-4892-9973-f7c3cbdc49d6","Type":"ContainerStarted","Data":"25df7b6f65bcf93403db73d66935d727f18a7a966348f4358db5e2bbf69ac4e3"} Jul 08 17:32:50.039372 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.038770 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c5bd444f-xbxps" event={"ID":"f0c200d1-e65c-4892-9973-f7c3cbdc49d6","Type":"ContainerStarted","Data":"854b6d0e20e20f3806c0a681e5093c9623abcfd8f44f73f0245772db8aa53a68"} Jul 08 17:32:50.084030 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.083967 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c5bd444f-xbxps" podStartSLOduration=1.619098642 podStartE2EDuration="2.083949972s" totalImagesPullingTime="464.85133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:32:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:32:50.082406635 +0000 UTC m=+820.541619167" watchObservedRunningTime="2026-07-08 17:32:50.083949972 +0000 UTC m=+820.543162504" Jul 08 17:32:50.240523 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.240450 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5589bc6f9b-bm6sq"] Jul 08 17:32:50.240665 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.240605 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" podUID="dfdf5610-a7cd-4058-918c-5cde8163c7d3" containerName="authorino" containerID="cri-o://fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6" gracePeriod=30 Jul 08 17:32:50.506795 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.506729 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:32:50.635612 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.635579 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhwrd\" (UniqueName: \"kubernetes.io/projected/dfdf5610-a7cd-4058-918c-5cde8163c7d3-kube-api-access-qhwrd\") pod \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\" (UID: \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\") " Jul 08 17:32:50.635791 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.635680 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfdf5610-a7cd-4058-918c-5cde8163c7d3-tls-cert\") pod \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\" (UID: \"dfdf5610-a7cd-4058-918c-5cde8163c7d3\") " Jul 08 17:32:50.637803 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.637763 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfdf5610-a7cd-4058-918c-5cde8163c7d3-kube-api-access-qhwrd" (OuterVolumeSpecName: "kube-api-access-qhwrd") pod "dfdf5610-a7cd-4058-918c-5cde8163c7d3" (UID: "dfdf5610-a7cd-4058-918c-5cde8163c7d3"). InnerVolumeSpecName "kube-api-access-qhwrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:32:50.646962 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.646934 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfdf5610-a7cd-4058-918c-5cde8163c7d3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dfdf5610-a7cd-4058-918c-5cde8163c7d3" (UID: "dfdf5610-a7cd-4058-918c-5cde8163c7d3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:32:50.736460 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.736421 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhwrd\" (UniqueName: \"kubernetes.io/projected/dfdf5610-a7cd-4058-918c-5cde8163c7d3-kube-api-access-qhwrd\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:32:50.736460 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:50.736456 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfdf5610-a7cd-4058-918c-5cde8163c7d3-tls-cert\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:32:51.046274 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.046241 2578 generic.go:356] "Generic (PLEG): container finished" podID="dfdf5610-a7cd-4058-918c-5cde8163c7d3" containerID="fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6" exitCode=0 Jul 08 17:32:51.046747 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.046289 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" Jul 08 17:32:51.046747 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.046326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" event={"ID":"dfdf5610-a7cd-4058-918c-5cde8163c7d3","Type":"ContainerDied","Data":"fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6"} Jul 08 17:32:51.046747 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.046373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5589bc6f9b-bm6sq" event={"ID":"dfdf5610-a7cd-4058-918c-5cde8163c7d3","Type":"ContainerDied","Data":"79d153b84b9553643a657a5525f3fabd9e5be14fd117910ace7b10d1f660db2f"} Jul 08 17:32:51.046747 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.046395 2578 scope.go:117] "RemoveContainer" containerID="fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6" Jul 08 17:32:51.056502 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.056486 2578 scope.go:117] "RemoveContainer" containerID="fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6" Jul 08 17:32:51.056760 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:32:51.056741 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6\": container with ID starting with fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6 not found: ID does not exist" containerID="fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6" Jul 08 17:32:51.056821 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.056767 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6"} err="failed to get container status \"fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6\": rpc error: code = NotFound desc = could not find container \"fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6\": container with ID starting with fb8a036d1d2c371cdb4c3bc72f308e406778faa0ce423c42dd897c992ab9a8c6 not found: ID does not exist" Jul 08 17:32:51.093799 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.093767 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5589bc6f9b-bm6sq"] Jul 08 17:32:51.101325 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.101300 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5589bc6f9b-bm6sq"] Jul 08 17:32:51.705617 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.705579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:32:51.967508 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:51.967403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:32:52.013318 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:32:52.013286 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfdf5610-a7cd-4058-918c-5cde8163c7d3" path="/var/lib/kubelet/pods/dfdf5610-a7cd-4058-918c-5cde8163c7d3/volumes" Jul 08 17:33:01.369304 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:33:01.369268 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:01.874095 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:01.874055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:03.616694 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:03.616590 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:09.987078 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:09.987046 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:34:09.988243 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:09.988222 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:34:38.484667 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:38.484628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:39.710091 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:39.710062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:43.038488 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:43.038450 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:43.142158 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:43.142115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:44.384893 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:44.384844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:44.484519 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:44.484487 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:44.591151 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:44.591113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:44.689442 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:44.689399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:51.371264 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:51.371231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:51.509178 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:51.509142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:51.633283 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:51.633172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:51.775558 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:51.775527 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:57.655470 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:57.655404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:57.755430 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:34:57.755394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:37:42.456693 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:37:42.456653 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:37:46.032442 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:37:46.032413 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:37:46.133714 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:37:46.133683 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:38:37.458960 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:37.458871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:38:55.219576 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:55.219540 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv"] Jul 08 17:38:55.220161 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:55.219769 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" podUID="01e56429-cdba-4d68-8686-a612b2d2b28c" containerName="manager" containerID="cri-o://7536ad19656f7af6803fecf831a7f080e7dca0f5fce2f54657c511b4aaf9d02f" gracePeriod=10 Jul 08 17:38:59.105685 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.105654 2578 generic.go:356] "Generic (PLEG): container finished" podID="01e56429-cdba-4d68-8686-a612b2d2b28c" containerID="7536ad19656f7af6803fecf831a7f080e7dca0f5fce2f54657c511b4aaf9d02f" exitCode=0 Jul 08 17:38:59.106074 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.105707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" event={"ID":"01e56429-cdba-4d68-8686-a612b2d2b28c","Type":"ContainerDied","Data":"7536ad19656f7af6803fecf831a7f080e7dca0f5fce2f54657c511b4aaf9d02f"} Jul 08 17:38:59.274669 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.274645 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:38:59.395503 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.395469 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stbwx\" (UniqueName: \"kubernetes.io/projected/01e56429-cdba-4d68-8686-a612b2d2b28c-kube-api-access-stbwx\") pod \"01e56429-cdba-4d68-8686-a612b2d2b28c\" (UID: \"01e56429-cdba-4d68-8686-a612b2d2b28c\") " Jul 08 17:38:59.395707 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.395531 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e56429-cdba-4d68-8686-a612b2d2b28c-extensions-socket-volume\") pod \"01e56429-cdba-4d68-8686-a612b2d2b28c\" (UID: \"01e56429-cdba-4d68-8686-a612b2d2b28c\") " Jul 08 17:38:59.395974 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.395949 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01e56429-cdba-4d68-8686-a612b2d2b28c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "01e56429-cdba-4d68-8686-a612b2d2b28c" (UID: "01e56429-cdba-4d68-8686-a612b2d2b28c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:38:59.397681 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.397652 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01e56429-cdba-4d68-8686-a612b2d2b28c-kube-api-access-stbwx" (OuterVolumeSpecName: "kube-api-access-stbwx") pod "01e56429-cdba-4d68-8686-a612b2d2b28c" (UID: "01e56429-cdba-4d68-8686-a612b2d2b28c"). InnerVolumeSpecName "kube-api-access-stbwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:38:59.497140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.497100 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stbwx\" (UniqueName: \"kubernetes.io/projected/01e56429-cdba-4d68-8686-a612b2d2b28c-kube-api-access-stbwx\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:38:59.497140 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:38:59.497132 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e56429-cdba-4d68-8686-a612b2d2b28c-extensions-socket-volume\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:39:00.112553 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:00.112518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" event={"ID":"01e56429-cdba-4d68-8686-a612b2d2b28c","Type":"ContainerDied","Data":"5f346dec909ae57ee66d7967e9811e93b5df08f4b3d4a97ce73a6278a15991ec"} Jul 08 17:39:00.113021 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:00.112569 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv" Jul 08 17:39:00.113021 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:00.112585 2578 scope.go:117] "RemoveContainer" containerID="7536ad19656f7af6803fecf831a7f080e7dca0f5fce2f54657c511b4aaf9d02f" Jul 08 17:39:00.133143 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:00.133114 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv"] Jul 08 17:39:00.137299 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:00.137273 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hppkv"] Jul 08 17:39:02.012074 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:02.012039 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01e56429-cdba-4d68-8686-a612b2d2b28c" path="/var/lib/kubelet/pods/01e56429-cdba-4d68-8686-a612b2d2b28c/volumes" Jul 08 17:39:10.025989 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:10.025959 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:39:10.027868 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:10.027836 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:39:56.386796 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.386760 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw"] Jul 08 17:39:56.387288 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.387125 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01e56429-cdba-4d68-8686-a612b2d2b28c" containerName="manager" Jul 08 17:39:56.387288 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.387136 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="01e56429-cdba-4d68-8686-a612b2d2b28c" containerName="manager" Jul 08 17:39:56.387288 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.387155 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfdf5610-a7cd-4058-918c-5cde8163c7d3" containerName="authorino" Jul 08 17:39:56.387288 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.387161 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfdf5610-a7cd-4058-918c-5cde8163c7d3" containerName="authorino" Jul 08 17:39:56.387288 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.387223 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="01e56429-cdba-4d68-8686-a612b2d2b28c" containerName="manager" Jul 08 17:39:56.387288 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.387231 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfdf5610-a7cd-4058-918c-5cde8163c7d3" containerName="authorino" Jul 08 17:39:56.389439 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.389421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:56.393285 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.393263 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hc4qn\"" Jul 08 17:39:56.433504 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.433477 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw"] Jul 08 17:39:56.493116 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.493085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kq4k\" (UniqueName: \"kubernetes.io/projected/b2e8f151-9e32-487f-86f0-6388bf3b1ba1-kube-api-access-8kq4k\") pod \"kuadrant-operator-controller-manager-86878c769f-v5skw\" (UID: \"b2e8f151-9e32-487f-86f0-6388bf3b1ba1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:56.493278 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.493133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2e8f151-9e32-487f-86f0-6388bf3b1ba1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5skw\" (UID: \"b2e8f151-9e32-487f-86f0-6388bf3b1ba1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:56.594607 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.594567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kq4k\" (UniqueName: \"kubernetes.io/projected/b2e8f151-9e32-487f-86f0-6388bf3b1ba1-kube-api-access-8kq4k\") pod \"kuadrant-operator-controller-manager-86878c769f-v5skw\" (UID: \"b2e8f151-9e32-487f-86f0-6388bf3b1ba1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:56.594762 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.594633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2e8f151-9e32-487f-86f0-6388bf3b1ba1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5skw\" (UID: \"b2e8f151-9e32-487f-86f0-6388bf3b1ba1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:56.595030 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.595013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2e8f151-9e32-487f-86f0-6388bf3b1ba1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5skw\" (UID: \"b2e8f151-9e32-487f-86f0-6388bf3b1ba1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:56.613811 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.613781 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kq4k\" (UniqueName: \"kubernetes.io/projected/b2e8f151-9e32-487f-86f0-6388bf3b1ba1-kube-api-access-8kq4k\") pod \"kuadrant-operator-controller-manager-86878c769f-v5skw\" (UID: \"b2e8f151-9e32-487f-86f0-6388bf3b1ba1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:56.699710 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.699621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:56.837951 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:56.837517 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw"] Jul 08 17:39:57.417727 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:57.417686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" event={"ID":"b2e8f151-9e32-487f-86f0-6388bf3b1ba1","Type":"ContainerStarted","Data":"107cb6917eda07ceb7d8c0bf4f49d42edf7eec65278468172752c210ce66997d"} Jul 08 17:39:57.418217 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:57.417743 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" event={"ID":"b2e8f151-9e32-487f-86f0-6388bf3b1ba1","Type":"ContainerStarted","Data":"87ac9e1be79467a20171b904a968ed1d4bf4f901a2c463724defe90b63563253"} Jul 08 17:39:57.418217 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:57.417766 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:39:57.440596 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:39:57.440548 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" podStartSLOduration=1.440531976 podStartE2EDuration="1.440531976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:39:57.439108609 +0000 UTC m=+1247.898321142" watchObservedRunningTime="2026-07-08 17:39:57.440531976 +0000 UTC m=+1247.899744507" Jul 08 17:40:08.425585 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:40:08.425512 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5skw" Jul 08 17:41:52.212657 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:41:52.212576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:53.446712 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:41:53.446678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:09.729192 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:44:09.729151 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:10.059444 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:44:10.059361 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:44:10.062666 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:44:10.062642 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:44:22.376923 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:44:22.376882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:44.450646 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:44:44.450561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:48.666164 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:45:48.666132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:58.203632 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:45:58.203586 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:06.465137 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:06.465037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:11.553494 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:11.553455 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:14.431785 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:14.431748 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:14.533560 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:14.533524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:14.864841 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:14.864752 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:21.250202 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.250167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:21.352055 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.352014 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:21.418871 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.418832 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd"] Jul 08 17:46:21.422273 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.422254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.424815 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.424787 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-786970cd-openshift-default-dockercfg-wdcf6\"" Jul 08 17:46:21.436563 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.436533 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd"] Jul 08 17:46:21.457488 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.457437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:21.524740 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.524650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-certs\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.524917 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.524733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-credential-socket\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.524917 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.524770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-istio-token\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.524917 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.524811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dba666c-f382-4692-8cde-84c9f978cdef-istio-podinfo\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.524917 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.524861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7kg\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-kube-api-access-pj7kg\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.525123 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.524955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-envoy\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.525123 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.525008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dba666c-f382-4692-8cde-84c9f978cdef-istiod-ca-cert\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.525123 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.525044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-data\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.525123 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.525106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-socket\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626161 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7kg\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-kube-api-access-pj7kg\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626377 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-envoy\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626377 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dba666c-f382-4692-8cde-84c9f978cdef-istiod-ca-cert\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626377 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-data\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626575 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-socket\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626575 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-certs\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626575 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-credential-socket\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626575 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-istio-token\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626575 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dba666c-f382-4692-8cde-84c9f978cdef-istio-podinfo\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626893 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-data\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.626893 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-certs\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.627026 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.626976 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-socket\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.627090 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.627025 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-credential-socket\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.627145 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.627112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dba666c-f382-4692-8cde-84c9f978cdef-istiod-ca-cert\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.628678 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.628654 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-envoy\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.629040 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.629022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dba666c-f382-4692-8cde-84c9f978cdef-istio-podinfo\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.634314 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.634281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-istio-token\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.634676 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.634653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7kg\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-kube-api-access-pj7kg\") pod \"e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.735497 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.735465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:21.882733 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.882707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd"] Jul 08 17:46:21.884577 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:46:21.884539 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dba666c_f382_4692_8cde_84c9f978cdef.slice/crio-e7d3badb0ecb7e81c96b4336d502101ccc2366eb8a5d7bd39e9e81b63bfdede4 WatchSource:0}: Error finding container e7d3badb0ecb7e81c96b4336d502101ccc2366eb8a5d7bd39e9e81b63bfdede4: Status 404 returned error can't find the container with id e7d3badb0ecb7e81c96b4336d502101ccc2366eb8a5d7bd39e9e81b63bfdede4 Jul 08 17:46:21.887274 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.887239 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:21.887405 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.887323 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:21.887405 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:21.887365 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:22.305406 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.305369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:22.561122 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.561018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" event={"ID":"0dba666c-f382-4692-8cde-84c9f978cdef","Type":"ContainerStarted","Data":"b7f95836ec5482bd32cfcd1c1f10a7a9b33a39d6e670473b66173ece2e9f1033"} Jul 08 17:46:22.561275 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.561135 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" event={"ID":"0dba666c-f382-4692-8cde-84c9f978cdef","Type":"ContainerStarted","Data":"e7d3badb0ecb7e81c96b4336d502101ccc2366eb8a5d7bd39e9e81b63bfdede4"} Jul 08 17:46:22.736618 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.736579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:22.742336 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.742309 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:22.764107 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.764073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:22.786751 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.786695 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" podStartSLOduration=1.7866786430000001 podStartE2EDuration="1.786678643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:22.632227908 +0000 UTC m=+1633.091440440" watchObservedRunningTime="2026-07-08 17:46:22.786678643 +0000 UTC m=+1633.245891175" Jul 08 17:46:22.872717 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.872628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:22.969457 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:22.969416 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:23.069728 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:23.069690 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:23.567429 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:23.567401 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:23.568355 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:23.568329 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:23.707197 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:23.707165 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:23.802401 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:23.802361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:25.374838 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:25.374808 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:34.639420 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:34.639383 2578 generic.go:356] "Generic (PLEG): container finished" podID="0dba666c-f382-4692-8cde-84c9f978cdef" containerID="b7f95836ec5482bd32cfcd1c1f10a7a9b33a39d6e670473b66173ece2e9f1033" exitCode=0 Jul 08 17:46:34.639872 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:34.639462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" event={"ID":"0dba666c-f382-4692-8cde-84c9f978cdef","Type":"ContainerDied","Data":"b7f95836ec5482bd32cfcd1c1f10a7a9b33a39d6e670473b66173ece2e9f1033"} Jul 08 17:46:34.639948 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:34.639934 2578 scope.go:117] "RemoveContainer" containerID="b7f95836ec5482bd32cfcd1c1f10a7a9b33a39d6e670473b66173ece2e9f1033" Jul 08 17:46:34.641003 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:34.640977 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:34.641067 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:34.641049 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:34.641108 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:34.641080 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:46:35.650982 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:35.650933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" event={"ID":"0dba666c-f382-4692-8cde-84c9f978cdef","Type":"ContainerStarted","Data":"832edb028f36b23e9bce74b377cc27030b3b203506c55b50280b42bb113e880a"} Jul 08 17:46:35.737840 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:35.737469 2578 patch_prober.go:28] interesting pod/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 08 17:46:35.737840 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:35.737557 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 08 17:46:35.738244 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:35.736140 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:36.736505 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:36.736461 2578 patch_prober.go:28] interesting pod/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 08 17:46:36.737031 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:36.736528 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 08 17:46:37.736946 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:37.736908 2578 patch_prober.go:28] interesting pod/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 08 17:46:37.737559 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:37.737525 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 08 17:46:38.568230 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:38.568180 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:38.736134 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:38.736090 2578 patch_prober.go:28] interesting pod/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 08 17:46:38.736353 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:38.736177 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 08 17:46:39.740524 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:39.740487 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:46:39.741598 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:46:39.741579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:47:27.721448 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:27.721413 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd"] Jul 08 17:47:27.721996 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:27.721624 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" containerID="cri-o://832edb028f36b23e9bce74b377cc27030b3b203506c55b50280b42bb113e880a" gracePeriod=30 Jul 08 17:47:27.747326 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:27.747282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:29.817217 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:29.817129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:32.967459 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:32.967433 2578 generic.go:356] "Generic (PLEG): container finished" podID="0dba666c-f382-4692-8cde-84c9f978cdef" containerID="832edb028f36b23e9bce74b377cc27030b3b203506c55b50280b42bb113e880a" exitCode=0 Jul 08 17:47:32.967876 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:32.967509 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" event={"ID":"0dba666c-f382-4692-8cde-84c9f978cdef","Type":"ContainerDied","Data":"832edb028f36b23e9bce74b377cc27030b3b203506c55b50280b42bb113e880a"} Jul 08 17:47:32.967876 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:32.967587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" event={"ID":"0dba666c-f382-4692-8cde-84c9f978cdef","Type":"ContainerDied","Data":"e7d3badb0ecb7e81c96b4336d502101ccc2366eb8a5d7bd39e9e81b63bfdede4"} Jul 08 17:47:32.967876 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:32.967615 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7d3badb0ecb7e81c96b4336d502101ccc2366eb8a5d7bd39e9e81b63bfdede4" Jul 08 17:47:32.967876 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:32.967650 2578 scope.go:117] "RemoveContainer" containerID="b7f95836ec5482bd32cfcd1c1f10a7a9b33a39d6e670473b66173ece2e9f1033" Jul 08 17:47:32.980838 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:32.980821 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:47:33.028112 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.028023 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:33.067324 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067299 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-credential-socket\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067444 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067378 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-istio-token\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067444 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067415 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj7kg\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-kube-api-access-pj7kg\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067577 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067555 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-certs\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067628 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067593 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:33.067628 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067618 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dba666c-f382-4692-8cde-84c9f978cdef-istio-podinfo\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067723 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067646 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-envoy\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067723 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067682 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-data\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067723 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067712 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dba666c-f382-4692-8cde-84c9f978cdef-istiod-ca-cert\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067903 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067738 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-socket\") pod \"0dba666c-f382-4692-8cde-84c9f978cdef\" (UID: \"0dba666c-f382-4692-8cde-84c9f978cdef\") " Jul 08 17:47:33.067903 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.067818 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:33.068241 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.068122 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:33.068241 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.068130 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dba666c-f382-4692-8cde-84c9f978cdef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:47:33.068241 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.068163 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-certs\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.068241 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.068182 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-credential-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.069147 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.069115 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-data" (OuterVolumeSpecName: "istio-data") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:33.070240 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.070209 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:33.070371 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.070343 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0dba666c-f382-4692-8cde-84c9f978cdef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:47:33.070371 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.070360 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-kube-api-access-pj7kg" (OuterVolumeSpecName: "kube-api-access-pj7kg") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "kube-api-access-pj7kg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:33.070450 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.070372 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-istio-token" (OuterVolumeSpecName: "istio-token") pod "0dba666c-f382-4692-8cde-84c9f978cdef" (UID: "0dba666c-f382-4692-8cde-84c9f978cdef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:33.169112 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.169076 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dba666c-f382-4692-8cde-84c9f978cdef-istio-podinfo\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.169112 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.169106 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-envoy\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.169112 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.169115 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-istio-data\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.169351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.169125 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dba666c-f382-4692-8cde-84c9f978cdef-istiod-ca-cert\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.169351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.169133 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dba666c-f382-4692-8cde-84c9f978cdef-workload-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.169351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.169142 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-istio-token\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.169351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.169150 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj7kg\" (UniqueName: \"kubernetes.io/projected/0dba666c-f382-4692-8cde-84c9f978cdef-kube-api-access-pj7kg\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:47:33.585754 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.585720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:33.817166 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.817129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:33.973779 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:33.973751 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd" Jul 08 17:47:34.012504 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:34.012475 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd"] Jul 08 17:47:34.016298 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:34.016275 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-786970cd-openshift-default-7bf476c6c5-n5hdd"] Jul 08 17:47:34.414190 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:34.414159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:36.012209 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:36.012177 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" path="/var/lib/kubelet/pods/0dba666c-f382-4692-8cde-84c9f978cdef/volumes" Jul 08 17:47:39.644154 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.644114 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:39.713709 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.713677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:39.826038 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.826005 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7"] Jul 08 17:47:39.826619 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.826588 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" Jul 08 17:47:39.826748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.826640 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" Jul 08 17:47:39.826748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.826712 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" Jul 08 17:47:39.826748 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.826720 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" Jul 08 17:47:39.829528 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.829508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.832425 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.832402 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cc97ffc3-openshift-default-dockercfg-dz2hc\"" Jul 08 17:47:39.845955 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.845923 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7"] Jul 08 17:47:39.866977 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.866940 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:39.930087 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.929997 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:39.935188 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-podinfo\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.935386 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-credential-socket\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.935386 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-envoy\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.935386 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfrzp\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-kube-api-access-mfrzp\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.935730 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-certs\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.935730 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-socket\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.935730 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-data\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.935730 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-token\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:39.935730 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:39.935612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a26601d-5f23-426f-94ce-7b5b848745d3-istiod-ca-cert\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036183 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-credential-socket\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036396 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-envoy\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036396 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfrzp\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-kube-api-access-mfrzp\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-certs\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-socket\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-data\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-token\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036520 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a26601d-5f23-426f-94ce-7b5b848745d3-istiod-ca-cert\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036833 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-podinfo\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036833 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036675 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-credential-socket\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.036833 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-certs\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.037023 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-socket\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.037023 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.036971 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-data\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.037292 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.037272 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a26601d-5f23-426f-94ce-7b5b848745d3-istiod-ca-cert\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.038563 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.038541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-envoy\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.038960 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.038943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-podinfo\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.045332 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.045310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfrzp\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-kube-api-access-mfrzp\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.045449 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.045352 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-token\") pod \"e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.141189 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.141156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:40.306411 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.306355 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7"] Jul 08 17:47:40.312516 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:47:40.312477 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a26601d_5f23_426f_94ce_7b5b848745d3.slice/crio-ab9d2036df2242066e1353bc9f67df534888f96d636dd0cb6d1d8fd5b9e63553 WatchSource:0}: Error finding container ab9d2036df2242066e1353bc9f67df534888f96d636dd0cb6d1d8fd5b9e63553: Status 404 returned error can't find the container with id ab9d2036df2242066e1353bc9f67df534888f96d636dd0cb6d1d8fd5b9e63553 Jul 08 17:47:40.314353 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.314320 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:47:40.314462 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.314382 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:47:40.314462 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:40.314412 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:47:41.012088 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:41.012051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" event={"ID":"8a26601d-5f23-426f-94ce-7b5b848745d3","Type":"ContainerStarted","Data":"7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad"} Jul 08 17:47:41.012494 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:41.012105 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" event={"ID":"8a26601d-5f23-426f-94ce-7b5b848745d3","Type":"ContainerStarted","Data":"ab9d2036df2242066e1353bc9f67df534888f96d636dd0cb6d1d8fd5b9e63553"} Jul 08 17:47:41.037872 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:41.037810 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" podStartSLOduration=2.037794317 podStartE2EDuration="2.037794317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:41.035621123 +0000 UTC m=+1711.494833667" watchObservedRunningTime="2026-07-08 17:47:41.037794317 +0000 UTC m=+1711.497006849" Jul 08 17:47:41.141420 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:41.141376 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:41.146489 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:41.146461 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:42.017238 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:42.017200 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:42.018088 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:42.018068 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:47:43.322254 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:47:43.322223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:10.094967 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:49:10.094937 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:49:10.099210 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:49:10.099182 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:49:25.689245 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:49:25.689207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:25.777570 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:49:25.777534 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:44.463738 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.463647 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7"] Jul 08 17:50:44.464194 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.463887 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" podUID="8a26601d-5f23-426f-94ce-7b5b848745d3" containerName="istio-proxy" containerID="cri-o://7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad" gracePeriod=30 Jul 08 17:50:44.486798 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.486756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:44.821922 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.821830 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf"] Jul 08 17:50:44.822329 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.822309 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" Jul 08 17:50:44.822329 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.822327 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dba666c-f382-4692-8cde-84c9f978cdef" containerName="istio-proxy" Jul 08 17:50:44.824741 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.824722 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.827176 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.827150 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9ad3129d-openshift-default-dockercfg-qvnfs\"" Jul 08 17:50:44.837549 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.837525 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf"] Jul 08 17:50:44.856942 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.856904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:44.903074 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-token\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.903269 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-credential-socket\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.903269 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-certs\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.903269 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-podinfo\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.903269 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istiod-ca-cert\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.903449 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-socket\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.903449 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-data\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.903449 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-envoy\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:44.903449 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:44.903407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ljff\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-kube-api-access-5ljff\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004087 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-socket\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004261 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-data\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004261 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-envoy\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004261 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljff\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-kube-api-access-5ljff\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004261 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-token\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004261 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-credential-socket\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004547 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-certs\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004547 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-podinfo\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004547 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istiod-ca-cert\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004547 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004529 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-socket\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004827 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-data\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.004827 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.004762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-credential-socket\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.005059 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.005041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-certs\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.005122 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.005049 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istiod-ca-cert\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.006476 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.006454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-envoy\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.006798 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.006780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-podinfo\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.013139 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.013109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-token\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.013316 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.013298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ljff\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-kube-api-access-5ljff\") pod \"e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.137392 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.137363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:45.283202 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.283177 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf"] Jul 08 17:50:45.284879 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:50:45.284832 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eaa4d15_2103_4bba_aaae_c62a8e35f1af.slice/crio-176b6787bbde46d44c99c58b29462a870d7f7c3807b79c3e05e4858c0cfba8d6 WatchSource:0}: Error finding container 176b6787bbde46d44c99c58b29462a870d7f7c3807b79c3e05e4858c0cfba8d6: Status 404 returned error can't find the container with id 176b6787bbde46d44c99c58b29462a870d7f7c3807b79c3e05e4858c0cfba8d6 Jul 08 17:50:45.286996 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.286959 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:50:45.287091 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.287048 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:50:45.287136 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:45.287088 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:50:46.062946 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:46.062912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" event={"ID":"5eaa4d15-2103-4bba-aaae-c62a8e35f1af","Type":"ContainerStarted","Data":"913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2"} Jul 08 17:50:46.063415 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:46.062963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" event={"ID":"5eaa4d15-2103-4bba-aaae-c62a8e35f1af","Type":"ContainerStarted","Data":"176b6787bbde46d44c99c58b29462a870d7f7c3807b79c3e05e4858c0cfba8d6"} Jul 08 17:50:46.086179 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:46.086133 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" podStartSLOduration=2.086116255 podStartE2EDuration="2.086116255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:50:46.083619952 +0000 UTC m=+1896.542832485" watchObservedRunningTime="2026-07-08 17:50:46.086116255 +0000 UTC m=+1896.545328787" Jul 08 17:50:46.137702 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:46.137667 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:46.142962 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:46.142938 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:47.068904 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:47.068865 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:47.069949 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:47.069929 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:50:49.717126 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.717102 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:50:49.854063 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854028 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfrzp\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-kube-api-access-mfrzp\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854081 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-certs\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854159 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-data\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854187 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-socket\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854237 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854215 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a26601d-5f23-426f-94ce-7b5b848745d3-istiod-ca-cert\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854445 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854254 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-podinfo\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854445 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854405 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-envoy\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854568 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854441 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:49.854568 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854450 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:49.854568 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854447 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-token\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854568 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854480 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:49.854568 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854518 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-credential-socket\") pod \"8a26601d-5f23-426f-94ce-7b5b848745d3\" (UID: \"8a26601d-5f23-426f-94ce-7b5b848745d3\") " Jul 08 17:50:49.854818 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854662 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a26601d-5f23-426f-94ce-7b5b848745d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:50:49.854818 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854763 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:49.855053 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.854999 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-credential-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:49.855053 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.855025 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-certs\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:49.855053 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.855039 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-data\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:49.855053 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.855052 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-workload-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:49.855204 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.855065 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a26601d-5f23-426f-94ce-7b5b848745d3-istiod-ca-cert\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:49.856559 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.856525 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:50:49.856559 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.856548 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:50:49.856786 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.856768 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-kube-api-access-mfrzp" (OuterVolumeSpecName: "kube-api-access-mfrzp") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "kube-api-access-mfrzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:50:49.856786 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.856776 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a26601d-5f23-426f-94ce-7b5b848745d3" (UID: "8a26601d-5f23-426f-94ce-7b5b848745d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:50:49.956452 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.956414 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-podinfo\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:49.956452 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.956449 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-envoy\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:49.956452 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.956458 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-istio-token\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:49.956702 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:49.956466 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfrzp\" (UniqueName: \"kubernetes.io/projected/8a26601d-5f23-426f-94ce-7b5b848745d3-kube-api-access-mfrzp\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:50:50.087349 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.087256 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a26601d-5f23-426f-94ce-7b5b848745d3" containerID="7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad" exitCode=0 Jul 08 17:50:50.087349 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.087304 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" Jul 08 17:50:50.087349 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.087337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" event={"ID":"8a26601d-5f23-426f-94ce-7b5b848745d3","Type":"ContainerDied","Data":"7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad"} Jul 08 17:50:50.087600 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.087378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7" event={"ID":"8a26601d-5f23-426f-94ce-7b5b848745d3","Type":"ContainerDied","Data":"ab9d2036df2242066e1353bc9f67df534888f96d636dd0cb6d1d8fd5b9e63553"} Jul 08 17:50:50.087600 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.087399 2578 scope.go:117] "RemoveContainer" containerID="7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad" Jul 08 17:50:50.096892 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.096871 2578 scope.go:117] "RemoveContainer" containerID="7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad" Jul 08 17:50:50.097178 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:50:50.097158 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad\": container with ID starting with 7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad not found: ID does not exist" containerID="7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad" Jul 08 17:50:50.097229 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.097188 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad"} err="failed to get container status \"7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad\": rpc error: code = NotFound desc = could not find container \"7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad\": container with ID starting with 7aaaf11ecf7e2c0f4aee784e57e2d26e7f71a0f5870a2fabf4178fd581dc68ad not found: ID does not exist" Jul 08 17:50:50.106831 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.106804 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7"] Jul 08 17:50:50.113487 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:50.113464 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cc97ffc3-openshift-default-5469977d99-cvpt7"] Jul 08 17:50:51.711235 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:51.711199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:51.770244 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:51.770209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:52.012014 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:50:52.011933 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a26601d-5f23-426f-94ce-7b5b848745d3" path="/var/lib/kubelet/pods/8a26601d-5f23-426f-94ce-7b5b848745d3/volumes" Jul 08 17:51:01.800354 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:51:01.800319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:01.878515 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:51:01.878479 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:05.116650 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:51:05.116620 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:48.016594 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:48.016547 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf"] Jul 08 17:52:48.017170 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:48.016758 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" podUID="5eaa4d15-2103-4bba-aaae-c62a8e35f1af" containerName="istio-proxy" containerID="cri-o://913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2" gracePeriod=30 Jul 08 17:52:48.133490 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:48.133457 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:50.021843 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:50.021806 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:50.263919 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:50.263886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:53.274730 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.274705 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:52:53.393130 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393099 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-credential-socket\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393289 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393141 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-socket\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393289 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393162 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-certs\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393289 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393182 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-envoy\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393289 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393212 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ljff\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-kube-api-access-5ljff\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393289 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393237 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-data\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393289 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393274 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istiod-ca-cert\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393332 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-token\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393377 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-podinfo\") pod \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\" (UID: \"5eaa4d15-2103-4bba-aaae-c62a8e35f1af\") " Jul 08 17:52:53.393614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393395 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:52:53.393614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393403 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:52:53.393614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393468 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:52:53.393614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393581 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-credential-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.393614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393600 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-data" (OuterVolumeSpecName: "istio-data") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:52:53.393614 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393604 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.393969 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393638 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-workload-certs\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.393969 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.393658 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:52:53.395444 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.395413 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:52:53.395552 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.395508 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-token" (OuterVolumeSpecName: "istio-token") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:52:53.395734 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.395711 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-kube-api-access-5ljff" (OuterVolumeSpecName: "kube-api-access-5ljff") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "kube-api-access-5ljff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:52:53.395837 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.395714 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5eaa4d15-2103-4bba-aaae-c62a8e35f1af" (UID: "5eaa4d15-2103-4bba-aaae-c62a8e35f1af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:52:53.494935 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.494893 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istiod-ca-cert\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.494935 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.494934 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-token\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.495142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.494948 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-podinfo\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.495142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.494961 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-envoy\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.495142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.494975 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ljff\" (UniqueName: \"kubernetes.io/projected/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-kube-api-access-5ljff\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.495142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.494988 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5eaa4d15-2103-4bba-aaae-c62a8e35f1af-istio-data\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:52:53.776692 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.776660 2578 generic.go:356] "Generic (PLEG): container finished" podID="5eaa4d15-2103-4bba-aaae-c62a8e35f1af" containerID="913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2" exitCode=0 Jul 08 17:52:53.776887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.776722 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" Jul 08 17:52:53.776887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.776751 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" event={"ID":"5eaa4d15-2103-4bba-aaae-c62a8e35f1af","Type":"ContainerDied","Data":"913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2"} Jul 08 17:52:53.776887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.776840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf" event={"ID":"5eaa4d15-2103-4bba-aaae-c62a8e35f1af","Type":"ContainerDied","Data":"176b6787bbde46d44c99c58b29462a870d7f7c3807b79c3e05e4858c0cfba8d6"} Jul 08 17:52:53.776887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.776872 2578 scope.go:117] "RemoveContainer" containerID="913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2" Jul 08 17:52:53.788718 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.788695 2578 scope.go:117] "RemoveContainer" containerID="913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2" Jul 08 17:52:53.789016 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:52:53.788995 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2\": container with ID starting with 913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2 not found: ID does not exist" containerID="913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2" Jul 08 17:52:53.789134 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.789023 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2"} err="failed to get container status \"913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2\": rpc error: code = NotFound desc = could not find container \"913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2\": container with ID starting with 913c62d0bddfd334dd39bb6c472f0ede6411b6a172751a37405f181363b3b7a2 not found: ID does not exist" Jul 08 17:52:53.801122 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.801093 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf"] Jul 08 17:52:53.806249 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:53.806225 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9ad3129d-openshift-default-6c5864fbd7-nfvxf"] Jul 08 17:52:54.012645 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:54.012603 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eaa4d15-2103-4bba-aaae-c62a8e35f1af" path="/var/lib/kubelet/pods/5eaa4d15-2103-4bba-aaae-c62a8e35f1af/volumes" Jul 08 17:52:56.204262 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:56.204221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:56.315478 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:56.315444 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:56.405523 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:56.405490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:56.505420 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:56.505325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:56.882835 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:56.882742 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:59.686130 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:52:59.686088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:10.200291 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:10.200261 2578 scope.go:117] "RemoveContainer" containerID="832edb028f36b23e9bce74b377cc27030b3b203506c55b50280b42bb113e880a" Jul 08 17:53:22.839260 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:22.839220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:28.915118 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:28.915076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:29.020163 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:29.020127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:44.820307 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:44.820217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:50.573371 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:50.573328 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:50.644331 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:50.644299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:50.758911 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:50.758880 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:50.856829 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:50.856737 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:54.480334 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:53:54.480302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:01.292803 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:01.292761 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:02.100983 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:02.100951 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:08.463543 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:08.463505 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:08.861901 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:08.861784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:08.965915 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:08.965873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:09.651584 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:09.651521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:09.831537 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:09.831503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:10.132638 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:10.132543 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:54:10.141089 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:10.141065 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:54:11.474572 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:11.474540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:17.575360 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:17.575311 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:17.675830 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:17.675796 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:18.238800 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:18.238756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:24.207393 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.207361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:24.307972 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.307937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:24.442425 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.442392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:24.763501 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.763452 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td"] Jul 08 17:54:24.764770 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.764745 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eaa4d15-2103-4bba-aaae-c62a8e35f1af" containerName="istio-proxy" Jul 08 17:54:24.764972 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.764936 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eaa4d15-2103-4bba-aaae-c62a8e35f1af" containerName="istio-proxy" Jul 08 17:54:24.765042 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.764980 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a26601d-5f23-426f-94ce-7b5b848745d3" containerName="istio-proxy" Jul 08 17:54:24.765042 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.764989 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a26601d-5f23-426f-94ce-7b5b848745d3" containerName="istio-proxy" Jul 08 17:54:24.765342 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.765316 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eaa4d15-2103-4bba-aaae-c62a8e35f1af" containerName="istio-proxy" Jul 08 17:54:24.765342 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.765345 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a26601d-5f23-426f-94ce-7b5b848745d3" containerName="istio-proxy" Jul 08 17:54:24.768490 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.768474 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.771311 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.771293 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9f98ee07-openshift-default-dockercfg-lknk7\"" Jul 08 17:54:24.792535 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.792507 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:24.798681 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.798660 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td"] Jul 08 17:54:24.836497 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-podinfo\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.836631 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-credential-socket\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.836631 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-token\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.836708 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k652j\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-kube-api-access-k652j\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.836744 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-data\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.836778 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-envoy\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.836778 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-socket\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.836844 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-certs\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.836844 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.836832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fea3d33-e195-4782-abf5-4944ca273d4e-istiod-ca-cert\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938109 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-podinfo\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938283 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-credential-socket\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938283 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-token\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938283 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938173 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k652j\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-kube-api-access-k652j\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938283 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-data\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938283 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-envoy\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938283 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-socket\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938601 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-certs\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938601 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fea3d33-e195-4782-abf5-4944ca273d4e-istiod-ca-cert\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938601 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-credential-socket\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938764 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-socket\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938827 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-certs\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.938935 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.938885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-data\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.939041 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.939024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fea3d33-e195-4782-abf5-4944ca273d4e-istiod-ca-cert\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.940862 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.940826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-podinfo\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.940975 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.940932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-envoy\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.946829 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.946804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-token\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:24.946959 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:24.946939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k652j\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-kube-api-access-k652j\") pod \"e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:25.078488 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:25.078401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:25.205053 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:25.205015 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:54:25.225261 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:25.225237 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td"] Jul 08 17:54:25.226614 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:54:25.226592 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fea3d33_e195_4782_abf5_4944ca273d4e.slice/crio-b7265849ae4c45b61fa30c1ecf95826396642e05bedf8c307cfb6f4357f6407d WatchSource:0}: Error finding container b7265849ae4c45b61fa30c1ecf95826396642e05bedf8c307cfb6f4357f6407d: Status 404 returned error can't find the container with id b7265849ae4c45b61fa30c1ecf95826396642e05bedf8c307cfb6f4357f6407d Jul 08 17:54:25.228592 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:25.228562 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:54:25.228672 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:25.228624 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:54:25.228672 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:25.228655 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:54:25.271124 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:25.271091 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" event={"ID":"1fea3d33-e195-4782-abf5-4944ca273d4e","Type":"ContainerStarted","Data":"b7265849ae4c45b61fa30c1ecf95826396642e05bedf8c307cfb6f4357f6407d"} Jul 08 17:54:26.278302 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:26.278260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" event={"ID":"1fea3d33-e195-4782-abf5-4944ca273d4e","Type":"ContainerStarted","Data":"2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa"} Jul 08 17:54:26.300922 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:26.300868 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" podStartSLOduration=2.300837578 podStartE2EDuration="2.300837578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:26.298016928 +0000 UTC m=+2116.757229460" watchObservedRunningTime="2026-07-08 17:54:26.300837578 +0000 UTC m=+2116.760050110" Jul 08 17:54:27.078766 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:27.078720 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:27.084761 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:27.084734 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:27.283982 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:27.283957 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:54:27.284961 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:54:27.284939 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:56:33.637505 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:56:33.637401 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:32.712977 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:32.712940 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td"] Jul 08 17:57:32.715586 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:32.713194 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" podUID="1fea3d33-e195-4782-abf5-4944ca273d4e" containerName="istio-proxy" containerID="cri-o://2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa" gracePeriod=30 Jul 08 17:57:32.730922 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:32.730897 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:33.844572 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:33.844542 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:33.904069 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:33.904037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:37.985114 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:37.985057 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:57:38.095573 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095539 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-token\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.095763 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095598 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-data\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.095763 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095624 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-credential-socket\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.095763 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095680 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k652j\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-kube-api-access-k652j\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.095763 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095717 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-certs\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.096013 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095775 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-envoy\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.096013 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095818 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-socket\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.096013 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095884 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fea3d33-e195-4782-abf5-4944ca273d4e-istiod-ca-cert\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.096013 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095925 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-podinfo\") pod \"1fea3d33-e195-4782-abf5-4944ca273d4e\" (UID: \"1fea3d33-e195-4782-abf5-4944ca273d4e\") " Jul 08 17:57:38.096013 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095982 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:57:38.096253 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.095996 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:57:38.096253 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.096076 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:57:38.096253 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.096216 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:57:38.096406 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.096291 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fea3d33-e195-4782-abf5-4944ca273d4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:57:38.096406 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.096376 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-data\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.096406 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.096397 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-credential-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.096573 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.096412 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-certs\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.096573 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.096425 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-workload-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.097909 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.097878 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:57:38.098022 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.097949 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:57:38.098280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.098260 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-kube-api-access-k652j" (OuterVolumeSpecName: "kube-api-access-k652j") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "kube-api-access-k652j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:57:38.098351 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.098331 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fea3d33-e195-4782-abf5-4944ca273d4e" (UID: "1fea3d33-e195-4782-abf5-4944ca273d4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:57:38.197887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.197841 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fea3d33-e195-4782-abf5-4944ca273d4e-istiod-ca-cert\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.197887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.197881 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-podinfo\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.197887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.197889 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-token\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.197887 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.197899 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k652j\" (UniqueName: \"kubernetes.io/projected/1fea3d33-e195-4782-abf5-4944ca273d4e-kube-api-access-k652j\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.198163 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.197908 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fea3d33-e195-4782-abf5-4944ca273d4e-istio-envoy\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 17:57:38.309543 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.309455 2578 generic.go:356] "Generic (PLEG): container finished" podID="1fea3d33-e195-4782-abf5-4944ca273d4e" containerID="2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa" exitCode=0 Jul 08 17:57:38.309543 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.309500 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" Jul 08 17:57:38.309734 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.309539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" event={"ID":"1fea3d33-e195-4782-abf5-4944ca273d4e","Type":"ContainerDied","Data":"2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa"} Jul 08 17:57:38.309734 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.309594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td" event={"ID":"1fea3d33-e195-4782-abf5-4944ca273d4e","Type":"ContainerDied","Data":"b7265849ae4c45b61fa30c1ecf95826396642e05bedf8c307cfb6f4357f6407d"} Jul 08 17:57:38.309734 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.309619 2578 scope.go:117] "RemoveContainer" containerID="2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa" Jul 08 17:57:38.319624 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.319607 2578 scope.go:117] "RemoveContainer" containerID="2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa" Jul 08 17:57:38.319912 ip-10-0-131-141 kubenswrapper[2578]: E0708 17:57:38.319893 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa\": container with ID starting with 2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa not found: ID does not exist" containerID="2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa" Jul 08 17:57:38.319975 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.319922 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa"} err="failed to get container status \"2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa\": rpc error: code = NotFound desc = could not find container \"2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa\": container with ID starting with 2a53543b32d66a027bb32954df5cd10f4832a9f06a99a209a0fd3e9b5a313dfa not found: ID does not exist" Jul 08 17:57:38.332784 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.332758 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td"] Jul 08 17:57:38.336984 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:38.336962 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9f98ee07-openshift-default-84fb6955f9-s42td"] Jul 08 17:57:39.232394 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:39.232358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:39.306481 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:39.306452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:39.415443 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:39.415413 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:39.620407 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:39.620318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:40.012305 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:40.012267 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fea3d33-e195-4782-abf5-4944ca273d4e" path="/var/lib/kubelet/pods/1fea3d33-e195-4782-abf5-4944ca273d4e/volumes" Jul 08 17:57:45.443446 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:45.443414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:45.554521 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:45.554490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:52.155798 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.155766 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:52.437642 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.437553 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h"] Jul 08 17:57:52.438142 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.438124 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fea3d33-e195-4782-abf5-4944ca273d4e" containerName="istio-proxy" Jul 08 17:57:52.438258 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.438144 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fea3d33-e195-4782-abf5-4944ca273d4e" containerName="istio-proxy" Jul 08 17:57:52.438354 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.438279 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fea3d33-e195-4782-abf5-4944ca273d4e" containerName="istio-proxy" Jul 08 17:57:52.441483 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.441464 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.444039 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.444018 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-16a28f03-openshift-default-dockercfg-hqnls\"" Jul 08 17:57:52.451846 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.451823 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h"] Jul 08 17:57:52.632658 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.632619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-envoy\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.632658 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.632657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc814c86-857f-4d8e-9c3b-39120da2da3a-istiod-ca-cert\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.632930 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.632677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngjxv\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-kube-api-access-ngjxv\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.632930 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.632777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-credential-socket\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.632930 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.632808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-socket\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.632930 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.632827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-token\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.633154 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.632946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-data\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.633154 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.633023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-certs\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.633154 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.633050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-podinfo\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.733769 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.733675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-certs\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.733769 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.733712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-podinfo\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.733769 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.733767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-envoy\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.733791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc814c86-857f-4d8e-9c3b-39120da2da3a-istiod-ca-cert\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.733824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngjxv\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-kube-api-access-ngjxv\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.733913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-credential-socket\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.733954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-socket\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.733982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-token\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734086 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.734027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-data\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734414 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.734139 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-certs\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734414 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.734286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-data\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734516 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.734424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-credential-socket\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734580 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.734558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-socket\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.734622 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.734594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc814c86-857f-4d8e-9c3b-39120da2da3a-istiod-ca-cert\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.736576 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.736556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-envoy\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.736935 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.736912 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-podinfo\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.743286 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.743260 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-token\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.743564 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.743540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngjxv\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-kube-api-access-ngjxv\") pod \"e2e-mt-16a28f03-openshift-default-dc855d847-xv24h\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.753234 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.753211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:52.902006 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.901981 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h"] Jul 08 17:57:52.903576 ip-10-0-131-141 kubenswrapper[2578]: W0708 17:57:52.903547 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc814c86_857f_4d8e_9c3b_39120da2da3a.slice/crio-2f68668bf8541a70fa9d82e09847d47a4fe2565595e7253a9136937876eadd70 WatchSource:0}: Error finding container 2f68668bf8541a70fa9d82e09847d47a4fe2565595e7253a9136937876eadd70: Status 404 returned error can't find the container with id 2f68668bf8541a70fa9d82e09847d47a4fe2565595e7253a9136937876eadd70 Jul 08 17:57:52.906055 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.906022 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:57:52.906190 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.906090 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:57:52.906190 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:52.906122 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 17:57:53.398144 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:53.398103 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" event={"ID":"fc814c86-857f-4d8e-9c3b-39120da2da3a","Type":"ContainerStarted","Data":"6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb"} Jul 08 17:57:53.398642 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:53.398159 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" event={"ID":"fc814c86-857f-4d8e-9c3b-39120da2da3a","Type":"ContainerStarted","Data":"2f68668bf8541a70fa9d82e09847d47a4fe2565595e7253a9136937876eadd70"} Jul 08 17:57:53.429810 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:53.429753 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" podStartSLOduration=1.4297337909999999 podStartE2EDuration="1.429733791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:57:53.420960484 +0000 UTC m=+2323.880173016" watchObservedRunningTime="2026-07-08 17:57:53.429733791 +0000 UTC m=+2323.888946322" Jul 08 17:57:53.753715 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:53.753639 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:53.758771 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:53.758748 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:54.401372 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:54.401337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:54.404282 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:54.404257 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:57:54.405280 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:57:54.405254 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 17:59:10.170920 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:59:10.170881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:59:10.178071 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:59:10.178047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 17:59:22.245020 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:59:22.244984 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:59:30.703431 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:59:30.703390 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:59:33.124157 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:59:33.124080 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 17:59:33.684585 ip-10-0-131-141 kubenswrapper[2578]: I0708 17:59:33.684551 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:00:59.344884 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:00:59.344837 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h"] Jul 08 18:00:59.345525 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:00:59.345042 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" podUID="fc814c86-857f-4d8e-9c3b-39120da2da3a" containerName="istio-proxy" containerID="cri-o://6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb" gracePeriod=30 Jul 08 18:00:59.383577 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:00:59.383538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:00.656335 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:00.656301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:00.769535 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:00.769491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:00.884534 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:00.884490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:01.613020 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:01.612967 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:01.818338 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:01.818305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:03.232227 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:03.232138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:04.615442 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.615379 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 18:01:04.674384 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674354 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngjxv\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-kube-api-access-ngjxv\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.674573 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674393 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-data\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.674573 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674412 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-socket\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.674573 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674444 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-token\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.674573 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674467 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc814c86-857f-4d8e-9c3b-39120da2da3a-istiod-ca-cert\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.674573 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674481 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-credential-socket\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.674573 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674509 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-envoy\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.674573 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674539 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-podinfo\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.675007 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674596 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-certs\") pod \"fc814c86-857f-4d8e-9c3b-39120da2da3a\" (UID: \"fc814c86-857f-4d8e-9c3b-39120da2da3a\") " Jul 08 18:01:04.675007 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674652 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:01:04.675007 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674792 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:01:04.675007 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674878 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:01:04.675007 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674966 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-data\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:04.675007 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.674995 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:04.675007 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.675011 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-credential-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:04.675360 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.675010 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:01:04.675360 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.675257 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc814c86-857f-4d8e-9c3b-39120da2da3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:01:04.676766 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.676739 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:01:04.676919 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.676791 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-kube-api-access-ngjxv" (OuterVolumeSpecName: "kube-api-access-ngjxv") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "kube-api-access-ngjxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:01:04.677122 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.677107 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:01:04.677175 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.677112 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc814c86-857f-4d8e-9c3b-39120da2da3a" (UID: "fc814c86-857f-4d8e-9c3b-39120da2da3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:01:04.776234 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.776194 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-token\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:04.776234 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.776225 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc814c86-857f-4d8e-9c3b-39120da2da3a-istiod-ca-cert\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:04.776234 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.776235 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-envoy\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:04.776234 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.776243 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc814c86-857f-4d8e-9c3b-39120da2da3a-istio-podinfo\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:04.776513 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.776251 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc814c86-857f-4d8e-9c3b-39120da2da3a-workload-certs\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:04.776513 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:04.776261 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngjxv\" (UniqueName: \"kubernetes.io/projected/fc814c86-857f-4d8e-9c3b-39120da2da3a-kube-api-access-ngjxv\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:01:05.455574 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.455535 2578 generic.go:356] "Generic (PLEG): container finished" podID="fc814c86-857f-4d8e-9c3b-39120da2da3a" containerID="6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb" exitCode=0 Jul 08 18:01:05.455769 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.455588 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" Jul 08 18:01:05.455769 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.455617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" event={"ID":"fc814c86-857f-4d8e-9c3b-39120da2da3a","Type":"ContainerDied","Data":"6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb"} Jul 08 18:01:05.455769 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.455686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h" event={"ID":"fc814c86-857f-4d8e-9c3b-39120da2da3a","Type":"ContainerDied","Data":"2f68668bf8541a70fa9d82e09847d47a4fe2565595e7253a9136937876eadd70"} Jul 08 18:01:05.455769 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.455711 2578 scope.go:117] "RemoveContainer" containerID="6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb" Jul 08 18:01:05.466027 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.465819 2578 scope.go:117] "RemoveContainer" containerID="6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb" Jul 08 18:01:05.466332 ip-10-0-131-141 kubenswrapper[2578]: E0708 18:01:05.466307 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb\": container with ID starting with 6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb not found: ID does not exist" containerID="6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb" Jul 08 18:01:05.466439 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.466343 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb"} err="failed to get container status \"6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb\": rpc error: code = NotFound desc = could not find container \"6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb\": container with ID starting with 6375facf238aaf829c47919ae6d7346a31da45445c2a02fab01648dc47f294bb not found: ID does not exist" Jul 08 18:01:05.480322 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.480291 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h"] Jul 08 18:01:05.490172 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:05.490143 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-16a28f03-openshift-default-dc855d847-xv24h"] Jul 08 18:01:06.013518 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:06.013487 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc814c86-857f-4d8e-9c3b-39120da2da3a" path="/var/lib/kubelet/pods/fc814c86-857f-4d8e-9c3b-39120da2da3a/volumes" Jul 08 18:01:09.309405 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:09.309369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:09.616921 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:09.616831 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:09.811323 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:09.811287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:12.408209 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:12.408172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:16.762194 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:16.762158 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:16.876716 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:16.876670 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:16.999959 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:16.999927 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:27.553276 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:27.553243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:27.914215 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:27.914173 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:48.890540 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:48.890508 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:54.734389 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:54.734351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:54.837039 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:54.837007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:55.107097 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.107012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:55.406583 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.406550 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h"] Jul 08 18:01:55.406943 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.406930 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc814c86-857f-4d8e-9c3b-39120da2da3a" containerName="istio-proxy" Jul 08 18:01:55.406943 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.406944 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc814c86-857f-4d8e-9c3b-39120da2da3a" containerName="istio-proxy" Jul 08 18:01:55.407034 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.407015 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc814c86-857f-4d8e-9c3b-39120da2da3a" containerName="istio-proxy" Jul 08 18:01:55.412376 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.412343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.415551 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.415520 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5227d3-openshift-default-dockercfg-gnkgk\"" Jul 08 18:01:55.436055 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.436027 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h"] Jul 08 18:01:55.437365 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-data\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.437498 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-podinfo\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.437498 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-token\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.437623 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-socket\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.437623 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-credential-socket\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.437623 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-certs\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.437623 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-envoy\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.437829 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf4mt\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-kube-api-access-qf4mt\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.437829 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.437646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d8c752-81ff-4b97-829e-de2cca076b1c-istiod-ca-cert\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.439864 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.439828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:55.538131 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-data\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538340 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-podinfo\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538340 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-token\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538340 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-socket\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538340 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-credential-socket\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538340 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-certs\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538340 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-envoy\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538736 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf4mt\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-kube-api-access-qf4mt\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538736 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d8c752-81ff-4b97-829e-de2cca076b1c-istiod-ca-cert\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538736 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-data\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538736 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538591 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-socket\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538736 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-credential-socket\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.538736 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.538708 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-certs\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.539201 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.539184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d8c752-81ff-4b97-829e-de2cca076b1c-istiod-ca-cert\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.540629 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.540601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-envoy\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.540736 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.540712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-podinfo\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.555912 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.555890 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf4mt\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-kube-api-access-qf4mt\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.559005 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.558982 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-token\") pod \"e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.723386 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.723289 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:55.878161 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.878138 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h"] Jul 08 18:01:55.879740 ip-10-0-131-141 kubenswrapper[2578]: W0708 18:01:55.879715 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d8c752_81ff_4b97_829e_de2cca076b1c.slice/crio-71b1a103edd663f0c79d4d66bcd7cafd64870955d9a2b9f8cb687f3e8fe3ee45 WatchSource:0}: Error finding container 71b1a103edd663f0c79d4d66bcd7cafd64870955d9a2b9f8cb687f3e8fe3ee45: Status 404 returned error can't find the container with id 71b1a103edd663f0c79d4d66bcd7cafd64870955d9a2b9f8cb687f3e8fe3ee45 Jul 08 18:01:55.881754 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.881725 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:01:55.881829 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.881786 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:01:55.881829 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:55.881814 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:01:56.027965 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:56.027878 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:01:56.735501 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:56.735456 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" event={"ID":"31d8c752-81ff-4b97-829e-de2cca076b1c","Type":"ContainerStarted","Data":"71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9"} Jul 08 18:01:56.735714 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:56.735531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" event={"ID":"31d8c752-81ff-4b97-829e-de2cca076b1c","Type":"ContainerStarted","Data":"71b1a103edd663f0c79d4d66bcd7cafd64870955d9a2b9f8cb687f3e8fe3ee45"} Jul 08 18:01:56.760951 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:56.760895 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" podStartSLOduration=1.760879928 podStartE2EDuration="1.760879928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:01:56.75797076 +0000 UTC m=+2567.217183293" watchObservedRunningTime="2026-07-08 18:01:56.760879928 +0000 UTC m=+2567.220092460" Jul 08 18:01:57.723777 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:57.723739 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:57.728756 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:57.728729 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:57.741743 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:57.741718 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:01:57.742597 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:01:57.742579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:04:10.204875 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:04:10.204785 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 18:04:10.213823 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:04:10.213802 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 18:05:02.797647 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:02.797604 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h"] Jul 08 18:05:02.798261 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:02.797827 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" podUID="31d8c752-81ff-4b97-829e-de2cca076b1c" containerName="istio-proxy" containerID="cri-o://71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9" gracePeriod=30 Jul 08 18:05:02.847976 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:02.847942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:04.411996 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:04.411960 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59c5bd444f-xbxps_f0c200d1-e65c-4892-9973-f7c3cbdc49d6/authorino/0.log" Jul 08 18:05:08.057745 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.057720 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:05:08.098738 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.098658 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-data\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.098738 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.098725 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf4mt\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-kube-api-access-qf4mt\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.098967 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.098763 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-certs\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.098967 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.098809 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-socket\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.098967 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.098878 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d8c752-81ff-4b97-829e-de2cca076b1c-istiod-ca-cert\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.098967 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.098922 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-podinfo\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.098967 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.098950 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:08.099290 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.098977 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-token\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.099290 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099130 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-envoy\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.099290 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099139 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:08.099290 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099187 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-credential-socket\") pod \"31d8c752-81ff-4b97-829e-de2cca076b1c\" (UID: \"31d8c752-81ff-4b97-829e-de2cca076b1c\") " Jul 08 18:05:08.099502 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099312 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31d8c752-81ff-4b97-829e-de2cca076b1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:05:08.099683 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099552 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:08.099683 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099656 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:08.099846 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099741 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.099846 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099758 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31d8c752-81ff-4b97-829e-de2cca076b1c-istiod-ca-cert\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.099846 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099772 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-credential-socket\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.099846 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099785 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-data\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.099846 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.099797 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-workload-certs\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.101062 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.101026 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-kube-api-access-qf4mt" (OuterVolumeSpecName: "kube-api-access-qf4mt") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "kube-api-access-qf4mt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:08.101486 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.101447 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:08.101606 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.101530 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:08.101606 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.101530 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31d8c752-81ff-4b97-829e-de2cca076b1c" (UID: "31d8c752-81ff-4b97-829e-de2cca076b1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:05:08.200768 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.200727 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-podinfo\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.200768 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.200760 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-token\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.200768 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.200769 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31d8c752-81ff-4b97-829e-de2cca076b1c-istio-envoy\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.200768 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.200777 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf4mt\" (UniqueName: \"kubernetes.io/projected/31d8c752-81ff-4b97-829e-de2cca076b1c-kube-api-access-qf4mt\") on node \"ip-10-0-131-141.ec2.internal\" DevicePath \"\"" Jul 08 18:05:08.770403 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.770365 2578 generic.go:356] "Generic (PLEG): container finished" podID="31d8c752-81ff-4b97-829e-de2cca076b1c" containerID="71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9" exitCode=0 Jul 08 18:05:08.770608 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.770417 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" Jul 08 18:05:08.770608 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.770419 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" event={"ID":"31d8c752-81ff-4b97-829e-de2cca076b1c","Type":"ContainerDied","Data":"71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9"} Jul 08 18:05:08.770608 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.770554 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h" event={"ID":"31d8c752-81ff-4b97-829e-de2cca076b1c","Type":"ContainerDied","Data":"71b1a103edd663f0c79d4d66bcd7cafd64870955d9a2b9f8cb687f3e8fe3ee45"} Jul 08 18:05:08.770608 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.770591 2578 scope.go:117] "RemoveContainer" containerID="71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9" Jul 08 18:05:08.780659 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.780640 2578 scope.go:117] "RemoveContainer" containerID="71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9" Jul 08 18:05:08.780945 ip-10-0-131-141 kubenswrapper[2578]: E0708 18:05:08.780924 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9\": container with ID starting with 71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9 not found: ID does not exist" containerID="71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9" Jul 08 18:05:08.781023 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.780957 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9"} err="failed to get container status \"71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9\": rpc error: code = NotFound desc = could not find container \"71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9\": container with ID starting with 71161bd3a4a9ab74087e76eb0958d553f8d39416c6e84e789ecc4c66555680f9 not found: ID does not exist" Jul 08 18:05:08.800161 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.800134 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h"] Jul 08 18:05:08.802354 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:08.802334 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5227d3-openshift-default-5b5bd5d9b7-lfl9h"] Jul 08 18:05:09.411602 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:09.411571 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wktpf_b7f82876-01bf-4978-8cef-10edd34e57d2/manager/0.log" Jul 08 18:05:09.802626 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:09.802551 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-574956cb5f-jhpjs_d9a6786f-6d20-4238-a56d-8ca36338f07a/copy-manifests/0.log" Jul 08 18:05:09.818598 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:09.818571 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-574956cb5f-jhpjs_d9a6786f-6d20-4238-a56d-8ca36338f07a/manager/0.log" Jul 08 18:05:10.012991 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.012958 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31d8c752-81ff-4b97-829e-de2cca076b1c" path="/var/lib/kubelet/pods/31d8c752-81ff-4b97-829e-de2cca076b1c/volumes" Jul 08 18:05:10.613974 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.613840 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j_ea11bc44-fcf0-46a7-af03-fecaafbbe46c/util/0.log" Jul 08 18:05:10.626202 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.626170 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j_ea11bc44-fcf0-46a7-af03-fecaafbbe46c/pull/0.log" Jul 08 18:05:10.637662 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.637640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j_ea11bc44-fcf0-46a7-af03-fecaafbbe46c/extract/0.log" Jul 08 18:05:10.753996 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.753968 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk_be2aa6bc-1622-48b1-bf0b-3f5b7bab772e/util/0.log" Jul 08 18:05:10.766145 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.766114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk_be2aa6bc-1622-48b1-bf0b-3f5b7bab772e/pull/0.log" Jul 08 18:05:10.776476 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.776454 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk_be2aa6bc-1622-48b1-bf0b-3f5b7bab772e/extract/0.log" Jul 08 18:05:10.897634 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.897600 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k_4e36bd00-972c-4632-b8df-681ae0df6eb7/util/0.log" Jul 08 18:05:10.911105 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.911080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k_4e36bd00-972c-4632-b8df-681ae0df6eb7/pull/0.log" Jul 08 18:05:10.922808 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:10.922783 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k_4e36bd00-972c-4632-b8df-681ae0df6eb7/extract/0.log" Jul 08 18:05:11.038804 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:11.038769 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7_b66e1469-04dc-4806-9231-0fbb7afc07d4/util/0.log" Jul 08 18:05:11.051151 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:11.051122 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7_b66e1469-04dc-4806-9231-0fbb7afc07d4/pull/0.log" Jul 08 18:05:11.067926 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:11.067899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7_b66e1469-04dc-4806-9231-0fbb7afc07d4/extract/0.log" Jul 08 18:05:11.208766 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:11.208679 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59c5bd444f-xbxps_f0c200d1-e65c-4892-9973-f7c3cbdc49d6/authorino/0.log" Jul 08 18:05:11.340411 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:11.340383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wmn6k_8a9d314b-be0a-4e09-931a-b613c2f0a535/manager/0.log" Jul 08 18:05:11.459507 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:11.459423 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nb4jp_df2b6b56-9c38-4456-adad-a76a2472672f/manager/0.log" Jul 08 18:05:11.696428 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:11.696394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pt2d2_33db8e5e-5930-4b46-bebe-3a898f6537b2/registry-server/0.log" Jul 08 18:05:11.838299 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:11.838223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-v5skw_b2e8f151-9e32-487f-86f0-6388bf3b1ba1/manager/0.log" Jul 08 18:05:12.474026 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:12.473991 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l8cqz_20d46654-aa3d-4c92-9adf-a8e022855d77/istio-proxy/0.log" Jul 08 18:05:12.984605 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:12.984572 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lvmvn_44ce844d-7409-460e-ac30-3901a2e83f86/istio-proxy/1.log" Jul 08 18:05:13.415281 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:13.415252 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86758f94cf-kbj9q_5b017360-f84c-4fb3-9df1-0c1b56ac9265/router/0.log" Jul 08 18:05:13.871111 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:13.870993 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-n4kst_aa219f5b-49c4-4179-b0ac-6b8d391a1d88/main/0.log" Jul 08 18:05:14.251229 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:14.251198 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-98465_8e164e3e-1e0c-4c18-a9a6-678eac4e5226/main/0.log" Jul 08 18:05:14.377491 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:14.377463 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-tstrm_3a371b8a-5e2d-4f5c-9a7a-8e7d087f73f3/main/0.log" Jul 08 18:05:18.473693 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:18.473654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:18.604379 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:18.604344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:21.892443 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:21.892410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cnw5g_a37ad3a8-2873-4048-9539-f94e08b4276c/global-pull-secret-syncer/0.log" Jul 08 18:05:22.003196 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:22.003164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2npq6_d6db8fec-cdec-4cab-ac55-d121f13b8800/konnectivity-agent/0.log" Jul 08 18:05:22.136297 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:22.136273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-141.ec2.internal_1b21606e895bcddad53722ead70cb377/haproxy/0.log" Jul 08 18:05:25.672584 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:25.672552 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j_ea11bc44-fcf0-46a7-af03-fecaafbbe46c/extract/0.log" Jul 08 18:05:25.779294 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:25.779265 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j_ea11bc44-fcf0-46a7-af03-fecaafbbe46c/util/0.log" Jul 08 18:05:25.859006 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:25.858978 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gbg9j_ea11bc44-fcf0-46a7-af03-fecaafbbe46c/pull/0.log" Jul 08 18:05:25.932554 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:25.932476 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk_be2aa6bc-1622-48b1-bf0b-3f5b7bab772e/extract/0.log" Jul 08 18:05:25.995259 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:25.995239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk_be2aa6bc-1622-48b1-bf0b-3f5b7bab772e/util/0.log" Jul 08 18:05:26.034212 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.034185 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jtsxk_be2aa6bc-1622-48b1-bf0b-3f5b7bab772e/pull/0.log" Jul 08 18:05:26.063055 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.063031 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k_4e36bd00-972c-4632-b8df-681ae0df6eb7/extract/0.log" Jul 08 18:05:26.090111 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.090089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k_4e36bd00-972c-4632-b8df-681ae0df6eb7/util/0.log" Jul 08 18:05:26.115274 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.115241 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7327d2k_4e36bd00-972c-4632-b8df-681ae0df6eb7/pull/0.log" Jul 08 18:05:26.148228 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.148200 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7_b66e1469-04dc-4806-9231-0fbb7afc07d4/extract/0.log" Jul 08 18:05:26.172598 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.172576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7_b66e1469-04dc-4806-9231-0fbb7afc07d4/util/0.log" Jul 08 18:05:26.197803 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.197726 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef197wd7_b66e1469-04dc-4806-9231-0fbb7afc07d4/pull/0.log" Jul 08 18:05:26.648948 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.648920 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59c5bd444f-xbxps_f0c200d1-e65c-4892-9973-f7c3cbdc49d6/authorino/0.log" Jul 08 18:05:26.691391 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.691364 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wmn6k_8a9d314b-be0a-4e09-931a-b613c2f0a535/manager/0.log" Jul 08 18:05:26.720275 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.720243 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nb4jp_df2b6b56-9c38-4456-adad-a76a2472672f/manager/0.log" Jul 08 18:05:26.815027 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.814996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pt2d2_33db8e5e-5930-4b46-bebe-3a898f6537b2/registry-server/0.log" Jul 08 18:05:26.932127 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:26.932095 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-v5skw_b2e8f151-9e32-487f-86f0-6388bf3b1ba1/manager/0.log" Jul 08 18:05:29.111108 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:29.111079 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-gg5lg_49028db6-f3b9-4a15-bcb6-6a181650330d/cluster-monitoring-operator/0.log" Jul 08 18:05:29.507342 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:29.507311 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52z6q_454b33d9-6565-479e-9fb7-3feda628c3a3/node-exporter/0.log" Jul 08 18:05:29.571388 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:29.571359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52z6q_454b33d9-6565-479e-9fb7-3feda628c3a3/kube-rbac-proxy/0.log" Jul 08 18:05:29.615827 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:29.615805 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52z6q_454b33d9-6565-479e-9fb7-3feda628c3a3/init-textfile/0.log" Jul 08 18:05:32.667248 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.667161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-q9vmd_55cd57c0-ee6d-4cbd-b5ed-c407d478d01e/networking-console-plugin/0.log" Jul 08 18:05:32.712792 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.712757 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7"] Jul 08 18:05:32.713180 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.713166 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d8c752-81ff-4b97-829e-de2cca076b1c" containerName="istio-proxy" Jul 08 18:05:32.713239 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.713181 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d8c752-81ff-4b97-829e-de2cca076b1c" containerName="istio-proxy" Jul 08 18:05:32.713279 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.713261 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31d8c752-81ff-4b97-829e-de2cca076b1c" containerName="istio-proxy" Jul 08 18:05:32.716248 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.716230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.720251 ip-10-0-131-141 kubenswrapper[2578]: E0708 18:05:32.720227 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-7l84t\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-7l84t\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 08 18:05:32.720631 ip-10-0-131-141 kubenswrapper[2578]: E0708 18:05:32.720614 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-7p7mm\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-must-gather-7l84t\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-7l84t\"/\"default-dockercfg-7p7mm\"" type="*v1.Secret" Jul 08 18:05:32.724795 ip-10-0-131-141 kubenswrapper[2578]: E0708 18:05:32.724763 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"perf-node-gather-daemonset-d47d7\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7l84t\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" podUID="92461bdf-9419-4cab-b0c6-980a803684bd" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.725004 ip-10-0-131-141 kubenswrapper[2578]: E0708 18:05:32.724980 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-131-141.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-7l84t\": no relationship found between node 'ip-10-0-131-141.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-7l84t\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 08 18:05:32.747132 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.747104 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7"] Jul 08 18:05:32.827293 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.827262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-lib-modules\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.827514 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.827311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-sys\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.827514 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.827383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-podres\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.827514 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.827414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89zr4\" (UniqueName: \"kubernetes.io/projected/92461bdf-9419-4cab-b0c6-980a803684bd-kube-api-access-89zr4\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.827514 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.827437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-proc\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.928985 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.928902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-lib-modules\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.928985 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.928950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-sys\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.929217 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.928987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-podres\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.929217 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.929007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89zr4\" (UniqueName: \"kubernetes.io/projected/92461bdf-9419-4cab-b0c6-980a803684bd-kube-api-access-89zr4\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.929217 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.929029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-proc\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.929217 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.929082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-lib-modules\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.929217 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.929130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-sys\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.929217 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.929142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-proc\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:32.929217 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:32.929142 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92461bdf-9419-4cab-b0c6-980a803684bd-podres\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:33.401233 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:33.401200 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/1.log" Jul 08 18:05:33.408896 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:33.408865 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-zqsgm_f2026397-8006-4d0d-839e-d050b6080d09/console-operator/2.log" Jul 08 18:05:33.695510 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:33.695419 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7l84t\"/\"openshift-service-ca.crt\"" Jul 08 18:05:33.722926 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:33.722889 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7l84t\"/\"kube-root-ca.crt\"" Jul 08 18:05:33.724728 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:33.724710 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7l84t\"/\"default-dockercfg-7p7mm\"" Jul 08 18:05:33.733939 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:33.733917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89zr4\" (UniqueName: \"kubernetes.io/projected/92461bdf-9419-4cab-b0c6-980a803684bd-kube-api-access-89zr4\") pod \"perf-node-gather-daemonset-d47d7\" (UID: \"92461bdf-9419-4cab-b0c6-980a803684bd\") " pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:33.926268 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:33.926230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:34.078771 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:34.078736 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7"] Jul 08 18:05:34.082487 ip-10-0-131-141 kubenswrapper[2578]: W0708 18:05:34.082462 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92461bdf_9419_4cab_b0c6_980a803684bd.slice/crio-2fc6824f9674b4ae5ab78d061fef25c2e662a19d333513ca2786e593ce1537da WatchSource:0}: Error finding container 2fc6824f9674b4ae5ab78d061fef25c2e662a19d333513ca2786e593ce1537da: Status 404 returned error can't find the container with id 2fc6824f9674b4ae5ab78d061fef25c2e662a19d333513ca2786e593ce1537da Jul 08 18:05:34.692707 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:34.692677 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-2wnv6_8f8668d7-e7fe-44c6-9060-8fa4512e4e6b/volume-data-source-validator/0.log" Jul 08 18:05:34.927340 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:34.927307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" event={"ID":"92461bdf-9419-4cab-b0c6-980a803684bd","Type":"ContainerStarted","Data":"49c625ecfc893147674b3d6d331b24f772748ae6ab23dfefbed3f1ee7191af1e"} Jul 08 18:05:34.927730 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:34.927355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" event={"ID":"92461bdf-9419-4cab-b0c6-980a803684bd","Type":"ContainerStarted","Data":"2fc6824f9674b4ae5ab78d061fef25c2e662a19d333513ca2786e593ce1537da"} Jul 08 18:05:34.927730 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:34.927392 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:34.948293 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:34.948197 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" podStartSLOduration=2.9481815620000003 podStartE2EDuration="2.948181562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:34.945269981 +0000 UTC m=+2785.404482512" watchObservedRunningTime="2026-07-08 18:05:34.948181562 +0000 UTC m=+2785.407394119" Jul 08 18:05:36.018159 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:36.018128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvpn2_8427131a-881d-406b-b7b0-babe272e3b24/dns/0.log" Jul 08 18:05:36.044406 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:36.044382 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvpn2_8427131a-881d-406b-b7b0-babe272e3b24/kube-rbac-proxy/0.log" Jul 08 18:05:36.080989 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:36.080962 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8l29s_c99ae904-7b63-4095-8f36-fc81fad48a13/dns-node-resolver/0.log" Jul 08 18:05:36.805963 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:36.805937 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vzffn_6a846c6d-9a94-452e-8097-b893b996e20e/node-ca/0.log" Jul 08 18:05:37.843950 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:37.843920 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l8cqz_20d46654-aa3d-4c92-9adf-a8e022855d77/istio-proxy/0.log" Jul 08 18:05:38.038381 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:38.038341 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lvmvn_44ce844d-7409-460e-ac30-3901a2e83f86/istio-proxy/0.log" Jul 08 18:05:38.091069 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:38.091036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lvmvn_44ce844d-7409-460e-ac30-3901a2e83f86/istio-proxy/1.log" Jul 08 18:05:38.276695 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:38.276661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86758f94cf-kbj9q_5b017360-f84c-4fb3-9df1-0c1b56ac9265/router/0.log" Jul 08 18:05:39.073915 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:39.073887 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dsdxq_25abc86d-e249-4ab8-9c88-3cbb563c8664/serve-healthcheck-canary/0.log" Jul 08 18:05:39.749237 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:39.749207 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-zpcl8_402eb9e5-0f3b-43f3-98c7-19053fdc6a5e/insights-operator/0.log" Jul 08 18:05:39.750641 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:39.750619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-zpcl8_402eb9e5-0f3b-43f3-98c7-19053fdc6a5e/insights-operator/1.log" Jul 08 18:05:39.784373 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:39.784347 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ss7k_eea690ae-4ab3-43dc-959d-fba5c7d6e6d3/kube-rbac-proxy/0.log" Jul 08 18:05:39.810447 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:39.810424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ss7k_eea690ae-4ab3-43dc-959d-fba5c7d6e6d3/exporter/0.log" Jul 08 18:05:39.842638 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:39.842601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2ss7k_eea690ae-4ab3-43dc-959d-fba5c7d6e6d3/extractor/0.log" Jul 08 18:05:40.942515 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:40.942490 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7l84t/perf-node-gather-daemonset-d47d7" Jul 08 18:05:42.293105 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:42.293078 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l8cqz_20d46654-aa3d-4c92-9adf-a8e022855d77/istio-proxy/0.log" Jul 08 18:05:42.428300 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:42.428247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lvmvn_44ce844d-7409-460e-ac30-3901a2e83f86/istio-proxy/0.log" Jul 08 18:05:42.483765 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:42.483735 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lvmvn_44ce844d-7409-460e-ac30-3901a2e83f86/istio-proxy/1.log" Jul 08 18:05:42.645569 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:42.645538 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86758f94cf-kbj9q_5b017360-f84c-4fb3-9df1-0c1b56ac9265/router/0.log" Jul 08 18:05:42.883728 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:42.883698 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wktpf_b7f82876-01bf-4978-8cef-10edd34e57d2/manager/0.log" Jul 08 18:05:43.189600 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:43.189562 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-574956cb5f-jhpjs_d9a6786f-6d20-4238-a56d-8ca36338f07a/manager/0.log" Jul 08 18:05:43.221267 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:43.221239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-574956cb5f-jhpjs_d9a6786f-6d20-4238-a56d-8ca36338f07a/copy-manifests/0.log" Jul 08 18:05:44.066608 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:44.066582 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l8cqz_20d46654-aa3d-4c92-9adf-a8e022855d77/istio-proxy/0.log" Jul 08 18:05:44.194998 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:44.194970 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lvmvn_44ce844d-7409-460e-ac30-3901a2e83f86/istio-proxy/0.log" Jul 08 18:05:44.250369 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:44.250333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-lvmvn_44ce844d-7409-460e-ac30-3901a2e83f86/istio-proxy/1.log" Jul 08 18:05:44.378156 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:44.378071 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86758f94cf-kbj9q_5b017360-f84c-4fb3-9df1-0c1b56ac9265/router/0.log" Jul 08 18:05:44.581293 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:44.581263 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b689d6b77-b8l25_e1ec1cba-2302-4c56-be51-30ebe8821d27/manager/0.log" Jul 08 18:05:50.300746 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:50.300715 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4zfwq_011d86f9-e7f5-4ac5-b36d-533952bd3bb3/migrator/0.log" Jul 08 18:05:50.366560 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:50.366528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4zfwq_011d86f9-e7f5-4ac5-b36d-533952bd3bb3/graceful-termination/0.log" Jul 08 18:05:50.888747 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:50.888710 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-wjm2t_2951c345-cc7f-472d-a1a1-7372286fd28f/kube-storage-version-migrator-operator/1.log" Jul 08 18:05:50.890325 ip-10-0-131-141 kubenswrapper[2578]: I0708 18:05:50.890301 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-wjm2t_2951c345-cc7f-472d-a1a1-7372286fd28f/kube-storage-version-migrator-operator/0.log"