Jul 06 22:25:26.146126 ip-10-0-132-3 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 22:25:26.146139 ip-10-0-132-3 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 22:25:26.146149 ip-10-0-132-3 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 22:25:26.146444 ip-10-0-132-3 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 22:25:37.258510 ip-10-0-132-3 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 22:25:37.258532 ip-10-0-132-3 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9ce961a9c55043eead467afc2361dcec -- Jul 06 22:27:29.368229 ip-10-0-132-3 systemd[1]: Starting Kubernetes Kubelet... Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.747698 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751186 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751196 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751200 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751203 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751206 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751208 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751214 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:27:29.803146 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751218 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751221 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751224 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751226 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751229 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751232 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751235 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751238 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751240 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751243 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751246 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751249 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751252 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751254 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751257 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751260 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751263 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751266 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751268 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751271 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:27:29.804025 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751273 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751276 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751278 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751281 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751283 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751286 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751288 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751291 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751293 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751296 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751299 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751307 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751310 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751312 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751315 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751317 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751320 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751323 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751325 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751328 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:27:29.806544 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751330 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751332 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751335 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751338 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751340 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751343 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751346 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751348 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751351 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751354 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751356 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751359 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751362 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751364 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751366 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751369 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751371 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751373 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751376 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751378 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:27:29.807439 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751381 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751383 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751386 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751388 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751396 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751398 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751402 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751406 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751409 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751412 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751415 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751417 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751420 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751423 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751426 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751429 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751432 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751434 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751437 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:27:29.808293 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751442 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751445 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751448 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751450 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751453 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751455 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751457 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751460 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751462 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751464 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751467 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751470 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.751472 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752236 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752245 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752250 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752254 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752257 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752262 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:27:29.811782 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752266 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:27:29.809368 ip-10-0-132-3 systemd[1]: Started Kubernetes Kubelet. Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752270 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752273 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752276 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752279 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752282 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752285 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752287 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752291 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752294 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752296 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752299 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752302 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752305 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752308 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752311 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752314 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752316 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752319 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752322 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:27:29.813271 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752325 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752328 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752331 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752334 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752337 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752339 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752342 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752345 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752348 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752350 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752352 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752355 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752359 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752362 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752364 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752367 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752369 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752372 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752374 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752377 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:27:29.816442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752380 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752383 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752385 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752388 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752390 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752393 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752396 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752399 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752401 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752404 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752406 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752408 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752411 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752414 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752417 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752419 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752421 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752424 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752426 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:27:29.817306 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752429 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752432 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752434 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752437 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752439 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752442 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752445 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752447 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752450 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752453 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752455 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752458 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752461 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752463 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752467 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752470 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752472 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752474 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752477 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752480 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:27:29.819197 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752483 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752485 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752487 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752490 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752492 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752495 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752498 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752500 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752503 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752506 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752508 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752511 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752513 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752515 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752881 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752886 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752889 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752892 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752895 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752897 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:27:29.820082 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752900 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752903 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752905 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752908 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752911 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752913 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752916 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752918 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752921 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752924 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752927 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752930 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752933 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752935 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752938 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752940 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752943 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752945 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752967 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752970 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:27:29.820854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752975 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752978 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752982 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752985 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752988 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752991 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752994 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752996 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.752999 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753002 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753004 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753007 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753010 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753013 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753015 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753018 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753020 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753023 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753026 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:27:29.821738 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753028 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753032 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753034 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753037 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753039 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753042 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753046 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753050 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753053 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753055 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753058 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753060 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753063 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753066 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753068 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753071 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753073 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753076 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753078 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753081 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:27:29.822582 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753083 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753086 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753088 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753091 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753093 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753096 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753099 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753102 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753104 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753107 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753109 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753113 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753116 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753118 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753121 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753125 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753128 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753131 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753135 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:27:29.823390 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753139 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753142 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753145 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753148 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753151 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753154 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753156 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753159 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753163 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753166 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753169 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753171 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753174 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753176 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753179 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753247 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753254 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753265 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753270 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753274 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753277 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 22:27:29.824354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753281 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753285 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753288 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753291 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753294 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753298 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753301 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753304 2577 flags.go:64] FLAG: --cgroup-root="" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753306 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753309 2577 flags.go:64] FLAG: --client-ca-file="" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753312 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753316 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753320 2577 flags.go:64] FLAG: --cluster-domain="" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753323 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753326 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753329 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753332 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753336 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753339 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753343 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753347 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753350 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753353 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753356 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 22:27:29.825806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753359 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753361 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753366 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753369 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753371 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753374 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753377 2577 flags.go:64] FLAG: --enable-server="true" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753381 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753386 2577 flags.go:64] FLAG: --event-burst="100" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753389 2577 flags.go:64] FLAG: --event-qps="50" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753392 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753395 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753398 2577 flags.go:64] FLAG: --eviction-hard="" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753401 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753404 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753407 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753410 2577 flags.go:64] FLAG: --eviction-soft="" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753413 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753416 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753420 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753423 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753426 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753429 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753432 2577 flags.go:64] FLAG: --feature-gates="" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753436 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 22:27:29.827272 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753439 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753442 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753446 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753449 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753452 2577 flags.go:64] FLAG: --help="false" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753455 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-132-3.ec2.internal" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753458 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753461 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753464 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753467 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753470 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753473 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753476 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753479 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753481 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753485 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753488 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753491 2577 flags.go:64] FLAG: --kube-reserved="" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753493 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753496 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753499 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753502 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753504 2577 flags.go:64] FLAG: --lock-file="" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753507 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 22:27:29.828900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753510 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753513 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753519 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753522 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753524 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753527 2577 flags.go:64] FLAG: --logging-format="text" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753531 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753534 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753537 2577 flags.go:64] FLAG: --manifest-url="" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753540 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753550 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753553 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753557 2577 flags.go:64] FLAG: --max-pods="110" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753560 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753563 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753566 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753569 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753571 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753574 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753577 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753583 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753586 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753589 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 22:27:29.829929 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753592 2577 flags.go:64] FLAG: --pod-cidr="" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753595 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753601 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753603 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753606 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753609 2577 flags.go:64] FLAG: --port="10250" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753612 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753615 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07631abd65c299f10" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753618 2577 flags.go:64] FLAG: --qos-reserved="" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753621 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753624 2577 flags.go:64] FLAG: --register-node="true" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753627 2577 flags.go:64] FLAG: --register-with-taints="" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753631 2577 flags.go:64] FLAG: --registry-burst="10" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753634 2577 flags.go:64] FLAG: --registry-qps="5" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753637 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753640 2577 flags.go:64] FLAG: --reserved-memory="" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753644 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753647 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753650 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753654 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753657 2577 flags.go:64] FLAG: --runonce="false" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753660 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753663 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753666 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753669 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 22:27:29.831404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753672 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753675 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753678 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753681 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753684 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753686 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753689 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753693 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753695 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753699 2577 flags.go:64] FLAG: --system-cgroups="" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753702 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753707 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753710 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753713 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753717 2577 flags.go:64] FLAG: --tls-min-version="" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753719 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753722 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753725 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753727 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753732 2577 flags.go:64] FLAG: --v="2" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753735 2577 flags.go:64] FLAG: --version="false" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753739 2577 flags.go:64] FLAG: --vmodule="" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753742 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.753745 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753867 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:27:29.834815 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753871 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753875 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753878 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753882 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753886 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753889 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753891 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753894 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753897 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753900 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753903 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753906 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753909 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753912 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753914 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753917 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753920 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753928 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753931 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753933 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:27:29.835832 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753936 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753938 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753941 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753944 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753960 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753965 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753970 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753973 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753975 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753978 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753981 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753983 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753986 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753990 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753992 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753995 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.753997 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754000 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754002 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754005 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:27:29.838335 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754008 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754010 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754013 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754015 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754018 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754021 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754023 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754026 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754028 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754031 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754034 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754037 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754041 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754044 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754047 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754049 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754052 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754054 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754058 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:27:29.839145 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754061 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754063 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754066 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754068 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754071 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754073 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754078 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754081 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754083 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754086 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754088 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754091 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754093 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754096 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754099 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754101 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754103 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754106 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754109 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754111 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:27:29.937377 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754114 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754117 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754119 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754123 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754130 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754133 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754135 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754138 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754140 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754143 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754145 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754149 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754151 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754154 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754156 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754159 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754161 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754164 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:27:29.938119 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.754168 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.754688 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.761097 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.761110 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.761129 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.761134 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761193 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761198 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761201 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761204 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761207 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761210 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761212 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761215 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761217 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:27:29.938881 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761220 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761222 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761225 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761228 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761231 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761234 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761237 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761240 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761242 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761245 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761248 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761250 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761253 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761256 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761261 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761264 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761268 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761271 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761275 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761278 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:27:29.939708 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761280 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761284 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761287 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761290 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761293 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761295 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761298 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761301 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761303 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761307 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761311 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761314 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761317 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761320 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761322 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761325 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761329 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761331 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761334 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761337 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:27:29.940475 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761340 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761342 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761345 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761347 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761350 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761352 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761355 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761358 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761360 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761363 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761368 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761371 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761373 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761376 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761378 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761381 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761383 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761386 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761389 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:27:29.943019 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761391 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761394 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761396 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761399 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761402 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761405 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761407 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761410 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761412 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761415 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761418 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761421 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761424 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761426 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761429 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761431 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761435 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761438 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761441 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:27:29.943772 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761443 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761446 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761448 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761451 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761455 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761457 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761460 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761462 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761465 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761467 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761470 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761472 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.761478 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761636 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761641 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 22:27:29.944539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761644 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761646 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761649 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761652 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761655 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761658 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761660 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761662 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761665 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761673 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761676 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761679 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761682 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761684 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761687 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761689 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761692 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761694 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761696 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761699 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 22:27:29.945354 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761701 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761705 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761707 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761710 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761712 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761715 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761717 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761720 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761722 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761725 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761727 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761730 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761732 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761734 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761738 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761741 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761743 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761746 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761749 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761751 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 22:27:29.946920 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761754 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761756 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761765 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761768 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761771 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761773 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761777 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761781 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761783 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761786 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761789 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761792 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761794 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761798 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761801 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761804 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761806 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761809 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761811 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 22:27:29.947692 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761814 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761816 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761819 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761821 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761824 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761826 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761829 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761833 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761835 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761838 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761840 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761843 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761845 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761848 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761850 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761853 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761861 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761864 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761866 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761869 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 22:27:29.949657 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761871 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761874 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761876 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761879 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761881 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761884 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761888 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761890 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761893 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761897 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761900 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761903 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761906 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761910 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761913 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761915 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761918 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 22:27:29.950441 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:29.761920 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.761925 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.762042 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.764039 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.765184 2577 server.go:1019] "Starting client certificate rotation" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.765283 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.765310 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.767748 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.772114 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.780303 2577 log.go:25] "Validated CRI v1 runtime API" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.782490 2577 log.go:25] "Validated CRI v1 image API" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.783185 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 22:27:29.952037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.785156 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cfd5aec9-51b8-4a4f-91d3-feb5e5bb5bb0:/dev/nvme0n1p3 e9483233-e5d2-48bd-b89f-ebb3550072c6:/dev/nvme0n1p4] Jul 06 22:27:29.952420 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.785169 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 22:27:29.953590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.790013 2577 manager.go:216] Machine: {Timestamp:2026-07-06 22:27:29.788728596 +0000 UTC m=+0.304368191 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103019 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27c616e6cc1a11e85f7d23094bc112 SystemUUID:ec27c616-e6cc-1a11-e85f-7d23094bc112 BootID:9ce961a9-c550-43ee-ad46-7afc2361dcec Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:19:dc:c0:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:19:dc:c0:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:b0:1c:fc:6d:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 22:27:29.953590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.790175 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 22:27:29.953590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.790262 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 22:27:29.953590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.793023 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 22:27:29.953590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.793052 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 22:27:29.953590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.794241 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 22:27:29.953590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.794255 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 22:27:29.953590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.794262 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.794835 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.795632 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.795920 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.799482 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.799596 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.799621 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.799633 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.799646 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.799655 2577 kubelet.go:398] "Adding apiserver pod source" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.799663 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.800070 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.800091 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.801910 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.803555 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.803587 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804602 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804623 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804632 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804637 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804646 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804651 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804659 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804665 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804679 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804687 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804700 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.804706 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.805365 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.805374 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.808628 2577 server.go:1268] "Started kubelet" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.808702 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.808704 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.808901 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.811500 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:29.815295 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.819498 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.824038 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.824045 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:29.824143 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.824706 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.824719 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.824723 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.824870 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ppz2q" Jul 06 22:27:29.954393 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.824972 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.824983 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.825007 2577 factory.go:55] Registering systemd factory Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.825020 2577 factory.go:223] Registration of the systemd container factory successfully Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.825228 2577 factory.go:153] Registering CRI-O factory Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.825240 2577 factory.go:223] Registration of the crio container factory successfully Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.825290 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.825314 2577 factory.go:103] Registering Raw factory Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.825340 2577 manager.go:1196] Started watching for new ooms in manager Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.825620 2577 manager.go:349] Starting recovery of all containers Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.833029 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ppz2q" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.835324 2577 manager.go:354] Recovery completed Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.839090 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.840743 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.840771 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.840785 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.841303 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.841312 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.841306 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.841329 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.843095 2577 policy_none.go:49] "None policy: Start" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.843108 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.843117 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:29.844904 2577 policy_none.go:47] "Start" Jul 06 22:27:29.956371 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:29.924534 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.060280 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.024853 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.182749 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.125054 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.311861 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.225311 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.330629 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.326153 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.454663 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.426765 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.597514 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.527355 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.718883 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.628040 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.729710 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.728610 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.845813 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.765016 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 22:27:30.845813 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.766064 2577 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://a8082d16bf4c84956a313ccd983ff840-591f23f1c8ca401a.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events\": read tcp 10.0.132.3:40324->52.73.240.128:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-132-3.ec2.internal.18bfd3cbd17ca269 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-3.ec2.internal,UID:ip-10-0-132-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-3.ec2.internal,},FirstTimestamp:2026-07-06 22:27:29.808433769 +0000 UTC m=+0.324073365,LastTimestamp:2026-07-06 22:27:29.808433769 +0000 UTC m=+0.324073365,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-3.ec2.internal,}" Jul 06 22:27:30.845813 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.828701 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:30.845813 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.836069 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 22:22:30 +0000 UTC" deadline="2028-01-25 08:31:38.406731254 +0000 UTC" Jul 06 22:27:30.845813 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.836092 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13618h4m7.570641963s" Jul 06 22:27:30.883391 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.883370 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:27:30.883473 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.883423 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:27:30.883473 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.883442 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:27:30.905686 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.905666 2577 manager.go:337] "Starting Device Plugin manager" Jul 06 22:27:30.905769 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.905732 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 22:27:30.905769 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.905742 2577 server.go:87] "Starting device plugin registration server" Jul 06 22:27:30.906026 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.906008 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 22:27:30.906091 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.906041 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 22:27:30.906215 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.906202 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 22:27:30.906302 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.906275 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 22:27:30.906302 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:30.906288 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 22:27:30.906744 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.906720 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 22:27:30.906825 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:30.906783 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.007544 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.007353 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:27:31.009264 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.008486 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:27:31.009264 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.008514 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:27:31.009264 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.008525 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:27:31.009264 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.008554 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.013164 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.013140 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 22:27:31.014493 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.014475 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 22:27:31.014551 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.014536 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 22:27:31.014608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.014566 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 22:27:31.014668 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.014600 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 22:27:31.017235 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.017214 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:27:31.018719 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.018704 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.018770 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.018727 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-3.ec2.internal\": node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.064674 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.064652 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.117730 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.117700 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal"] Jul 06 22:27:31.117816 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.117781 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:27:31.118592 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.118572 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:27:31.118672 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.118600 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:27:31.118672 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.118610 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:27:31.120633 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.120620 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:27:31.120779 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.120764 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.120818 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.120813 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:27:31.121352 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.121327 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:27:31.121440 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.121357 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:27:31.121440 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.121368 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:27:31.121440 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.121327 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:27:31.121440 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.121438 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:27:31.121600 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.121449 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:27:31.123441 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.123425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.123508 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.123453 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 22:27:31.124133 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.124119 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientMemory" Jul 06 22:27:31.124199 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.124142 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 22:27:31.124199 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.124153 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeHasSufficientPID" Jul 06 22:27:31.131056 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.131031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beeede9dcebf30c4ff3bef4de55e4fed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal\" (UID: \"beeede9dcebf30c4ff3bef4de55e4fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.131151 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.131073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fea9d108671560738be1beffe7846653-config\") pod \"kube-apiserver-proxy-ip-10-0-132-3.ec2.internal\" (UID: \"fea9d108671560738be1beffe7846653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.131151 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.131103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/beeede9dcebf30c4ff3bef4de55e4fed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal\" (UID: \"beeede9dcebf30c4ff3bef4de55e4fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.138593 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.138577 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-3.ec2.internal\" not found" node="ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.142639 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.142623 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-3.ec2.internal\" not found" node="ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.166204 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.166183 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.232367 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.232329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/beeede9dcebf30c4ff3bef4de55e4fed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal\" (UID: \"beeede9dcebf30c4ff3bef4de55e4fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.232367 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.232372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beeede9dcebf30c4ff3bef4de55e4fed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal\" (UID: \"beeede9dcebf30c4ff3bef4de55e4fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.232511 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.232392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fea9d108671560738be1beffe7846653-config\") pod \"kube-apiserver-proxy-ip-10-0-132-3.ec2.internal\" (UID: \"fea9d108671560738be1beffe7846653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.232511 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.232436 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/beeede9dcebf30c4ff3bef4de55e4fed-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal\" (UID: \"beeede9dcebf30c4ff3bef4de55e4fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.232511 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.232455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beeede9dcebf30c4ff3bef4de55e4fed-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal\" (UID: \"beeede9dcebf30c4ff3bef4de55e4fed\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.232511 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.232441 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fea9d108671560738be1beffe7846653-config\") pod \"kube-apiserver-proxy-ip-10-0-132-3.ec2.internal\" (UID: \"fea9d108671560738be1beffe7846653\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.268164 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.268116 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.370439 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.370399 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.441647 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.441616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.446385 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.446191 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.470717 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.470692 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.572824 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.572759 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.672918 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.672890 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-3.ec2.internal\" not found" Jul 06 22:27:31.768781 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.768745 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:27:31.768953 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.768918 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:27:31.771860 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.771840 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 22:27:31.800696 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.800671 2577 apiserver.go:52] "Watching apiserver" Jul 06 22:27:31.806926 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.806907 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 22:27:31.809965 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.809944 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-fjrnw","openshift-multus/multus-additional-cni-plugins-dj4jg","openshift-multus/network-metrics-daemon-5zvtm","openshift-ovn-kubernetes/ovnkube-node-cs28t","kube-system/konnectivity-agent-4dnm2","openshift-dns/node-resolver-grtsn","openshift-multus/multus-hpr82","openshift-network-diagnostics/network-check-target-bxv7s","openshift-network-operator/iptables-alerter-759g8","kube-system/global-pull-secret-syncer-9p5mm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq","openshift-cluster-node-tuning-operator/tuned-9szvq"] Jul 06 22:27:31.812316 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.812300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.814379 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.814356 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.814959 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.814943 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fw2k7\"" Jul 06 22:27:31.815050 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.814954 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 22:27:31.815227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.815209 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 22:27:31.815411 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.815398 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 22:27:31.816367 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.816349 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.817548 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.817533 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 22:27:31.817904 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.817870 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 22:27:31.818150 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.818131 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 22:27:31.818928 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.818906 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.819670 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.819643 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r8m4k\"" Jul 06 22:27:31.819792 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.819774 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 22:27:31.819883 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.819862 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 22:27:31.819943 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.819643 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 22:27:31.820067 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.820049 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wg2n6\"" Jul 06 22:27:31.820174 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.820158 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 22:27:31.820310 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.820295 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 22:27:31.821327 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.821306 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:31.821411 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.821371 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:31.821992 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.821924 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wrmwx\"" Jul 06 22:27:31.821992 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.821987 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 22:27:31.822137 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.821994 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:27:31.823614 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.823576 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.824562 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.824547 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.824653 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.824584 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 22:27:31.825773 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.825756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:31.826010 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.825990 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wbfb8\"" Jul 06 22:27:31.826141 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.826127 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 22:27:31.826466 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.826452 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 22:27:31.826466 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.826462 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 22:27:31.826995 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.826978 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 22:27:31.827839 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.827824 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 22:27:31.828314 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.828179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:31.829226 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.829210 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 22:27:31.829432 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.829416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 22:27:31.829514 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.829451 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 22:27:31.829514 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.829499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-94468\"" Jul 06 22:27:31.830550 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.830531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.830842 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.830795 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hxkgs\"" Jul 06 22:27:31.830977 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.830889 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 22:27:31.830977 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.830911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 22:27:31.832459 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.832444 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 22:27:31.832820 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.832792 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:31.832906 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.832860 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:31.832966 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.832947 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zfhkr\"" Jul 06 22:27:31.835289 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.835270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:31.837266 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-etc-selinux\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.837355 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-run-netns\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837355 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837355 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovn-node-metrics-cert\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837355 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.837588 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8pkz\" (UniqueName: \"kubernetes.io/projected/05812575-ef7b-462f-ba38-b7a7dce7ef68-kube-api-access-n8pkz\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.837588 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.837588 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv9hk\" (UniqueName: \"kubernetes.io/projected/8bd5f058-6082-42ac-b68c-3628d3155efd-kube-api-access-pv9hk\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.837588 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysctl-conf\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.837588 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837526 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:31.837588 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-cni-binary-copy\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.837588 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.837572 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-systemd-units\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-cnibin\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-device-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bshk\" (UniqueName: \"kubernetes.io/projected/b175a52e-2c98-4890-a694-c9e95cbc6c1b-kube-api-access-2bshk\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05812575-ef7b-462f-ba38-b7a7dce7ef68-serviceca\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k2mh\" (UniqueName: \"kubernetes.io/projected/38f84a1b-da72-45c1-9211-f643e5ffeca3-kube-api-access-5k2mh\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrbj7\" (UniqueName: \"kubernetes.io/projected/5027701b-787f-4cf2-a44e-6812631aadae-kube-api-access-rrbj7\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-kubelet\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-slash\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-node-log\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837856 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-env-overrides\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd4ddf05-5296-4df5-a1de-fddb9a7a2726-agent-certs\") pod \"konnectivity-agent-4dnm2\" (UID: \"dd4ddf05-5296-4df5-a1de-fddb9a7a2726\") " pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:31.837932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-tuned\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.837967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-cni-netd\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysctl-d\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-systemd\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-socket-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-etc-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838076 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovnkube-script-lib\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-os-release\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-kubernetes\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3da43f95-f768-4b34-9ef4-fd282cf45918-tmp\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-var-lib-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-system-cni-dir\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysconfig\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-registration-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-cni-bin\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-run\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-sys\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-var-lib-kubelet\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-ovn\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-systemd\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-host\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05812575-ef7b-462f-ba38-b7a7dce7ef68-host\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:31.838989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-sys-fs\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.839421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-log-socket\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.839421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd4ddf05-5296-4df5-a1de-fddb9a7a2726-konnectivity-ca\") pod \"konnectivity-agent-4dnm2\" (UID: \"dd4ddf05-5296-4df5-a1de-fddb9a7a2726\") " pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:31.839421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klgsz\" (UniqueName: \"kubernetes.io/projected/3da43f95-f768-4b34-9ef4-fd282cf45918-kube-api-access-klgsz\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.839421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovnkube-config\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.839421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-modprobe-d\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.839421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.838802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-lib-modules\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.840008 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.839994 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lws76\"" Jul 06 22:27:31.840082 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.840040 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:27:31.840522 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.840503 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 22:27:31.840645 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.840630 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 22:27:31.840714 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.840652 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 22:27:31.842594 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.842576 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal"] Jul 06 22:27:31.842664 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.842635 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:27:31.842722 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.842702 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" Jul 06 22:27:31.860822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.860805 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal"] Jul 06 22:27:31.861092 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.860970 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 22:27:31.867729 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.867712 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n8dd6" Jul 06 22:27:31.875228 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.875209 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n8dd6" Jul 06 22:27:31.926454 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.926434 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 22:27:31.939686 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-socket-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.939809 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-etc-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.939809 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovnkube-script-lib\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.939809 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-os-release\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.939809 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-etc-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.939809 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.939809 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939803 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-os-release\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939828 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-socket-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-kubernetes\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3da43f95-f768-4b34-9ef4-fd282cf45918-tmp\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939873 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-kubernetes\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-cnibin\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-var-lib-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-system-cni-dir\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysconfig\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9fede43d-c065-4ba5-8d6e-6c504e6754aa-dbus\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-var-lib-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-registration-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940057 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-registration-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.940185 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.939999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-openvswitch\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-system-cni-dir\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940001 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-cni-bin\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysconfig\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-cni-bin\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-run\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-sys\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940202 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-var-lib-kubelet\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-ovn\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-conf-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-sys\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-systemd\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.940852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-ovn\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-host\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940325 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-var-lib-kubelet\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05812575-ef7b-462f-ba38-b7a7dce7ef68-host\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-run-systemd\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-os-release\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940394 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-etc-kubernetes\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05812575-ef7b-462f-ba38-b7a7dce7ef68-host\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-host\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61af6460-42b8-47d5-babf-3e03a677d893-host-slash\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovnkube-script-lib\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhnkj\" (UniqueName: \"kubernetes.io/projected/61af6460-42b8-47d5-babf-3e03a677d893-kube-api-access-hhnkj\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-run\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-cni-bin\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.941667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-sys-fs\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-log-socket\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.940606 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd4ddf05-5296-4df5-a1de-fddb9a7a2726-konnectivity-ca\") pod \"konnectivity-agent-4dnm2\" (UID: \"dd4ddf05-5296-4df5-a1de-fddb9a7a2726\") " pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klgsz\" (UniqueName: \"kubernetes.io/projected/3da43f95-f768-4b34-9ef4-fd282cf45918-kube-api-access-klgsz\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:31.940683 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs podName:b175a52e-2c98-4890-a694-c9e95cbc6c1b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:32.440661216 +0000 UTC m=+2.956300835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs") pod "network-metrics-daemon-5zvtm" (UID: "b175a52e-2c98-4890-a694-c9e95cbc6c1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940695 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-tmp-dir\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-log-socket\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovnkube-config\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-modprobe-d\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-lib-modules\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-etc-selinux\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.942828 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-run-netns\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-modprobe-d\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovn-node-metrics-cert\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8pkz\" (UniqueName: \"kubernetes.io/projected/05812575-ef7b-462f-ba38-b7a7dce7ef68-kube-api-access-n8pkz\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940655 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-sys-fs\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-socket-dir-parent\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941015 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-cni-multus\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-lib-modules\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv9hk\" (UniqueName: \"kubernetes.io/projected/8bd5f058-6082-42ac-b68c-3628d3155efd-kube-api-access-pv9hk\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysctl-conf\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-daemon-config\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.943631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9fede43d-c065-4ba5-8d6e-6c504e6754aa-kubelet-config\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-cni-binary-copy\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5w2s\" (UniqueName: \"kubernetes.io/projected/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-kube-api-access-v5w2s\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-system-cni-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-multus-certs\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-systemd-units\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd4ddf05-5296-4df5-a1de-fddb9a7a2726-konnectivity-ca\") pod \"konnectivity-agent-4dnm2\" (UID: \"dd4ddf05-5296-4df5-a1de-fddb9a7a2726\") " pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-cnibin\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-cni-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-device-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bshk\" (UniqueName: \"kubernetes.io/projected/b175a52e-2c98-4890-a694-c9e95cbc6c1b-kube-api-access-2bshk\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05812575-ef7b-462f-ba38-b7a7dce7ef68-serviceca\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5027701b-787f-4cf2-a44e-6812631aadae-cnibin\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941463 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.944124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61af6460-42b8-47d5-babf-3e03a677d893-iptables-alerter-script\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-systemd-units\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k2mh\" (UniqueName: \"kubernetes.io/projected/38f84a1b-da72-45c1-9211-f643e5ffeca3-kube-api-access-5k2mh\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrbj7\" (UniqueName: \"kubernetes.io/projected/5027701b-787f-4cf2-a44e-6812631aadae-kube-api-access-rrbj7\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-hosts-file\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-k8s-cni-cncf-io\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-device-dir\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941436 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysctl-conf\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.940980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8bd5f058-6082-42ac-b68c-3628d3155efd-etc-selinux\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmrjw\" (UniqueName: \"kubernetes.io/projected/437ff35e-8d5f-4369-adf1-7a06710422b6-kube-api-access-rmrjw\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-kubelet\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-slash\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.944617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-node-log\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-env-overrides\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd4ddf05-5296-4df5-a1de-fddb9a7a2726-agent-certs\") pod \"konnectivity-agent-4dnm2\" (UID: \"dd4ddf05-5296-4df5-a1de-fddb9a7a2726\") " pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-tuned\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-slash\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-netns\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941902 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovnkube-config\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-kubelet\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-node-log\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-kubelet\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5027701b-787f-4cf2-a44e-6812631aadae-cni-binary-copy\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.941979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-cni-netd\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysctl-d\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.945098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942136 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-cni-netd\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942170 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-systemd\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/437ff35e-8d5f-4369-adf1-7a06710422b6-cni-binary-copy\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-systemd\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-hostroot\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-run-ovn-kubernetes\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/38f84a1b-da72-45c1-9211-f643e5ffeca3-env-overrides\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/05812575-ef7b-462f-ba38-b7a7dce7ef68-serviceca\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f84a1b-da72-45c1-9211-f643e5ffeca3-host-run-netns\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.942569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-sysctl-d\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.943689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3da43f95-f768-4b34-9ef4-fd282cf45918-tmp\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.943969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/38f84a1b-da72-45c1-9211-f643e5ffeca3-ovn-node-metrics-cert\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.944240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd4ddf05-5296-4df5-a1de-fddb9a7a2726-agent-certs\") pod \"konnectivity-agent-4dnm2\" (UID: \"dd4ddf05-5296-4df5-a1de-fddb9a7a2726\") " pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:31.945608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.944917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3da43f95-f768-4b34-9ef4-fd282cf45918-etc-tuned\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.955456 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.955233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klgsz\" (UniqueName: \"kubernetes.io/projected/3da43f95-f768-4b34-9ef4-fd282cf45918-kube-api-access-klgsz\") pod \"tuned-9szvq\" (UID: \"3da43f95-f768-4b34-9ef4-fd282cf45918\") " pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:31.955601 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.955547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k2mh\" (UniqueName: \"kubernetes.io/projected/38f84a1b-da72-45c1-9211-f643e5ffeca3-kube-api-access-5k2mh\") pod \"ovnkube-node-cs28t\" (UID: \"38f84a1b-da72-45c1-9211-f643e5ffeca3\") " pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:31.955601 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.955572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8pkz\" (UniqueName: \"kubernetes.io/projected/05812575-ef7b-462f-ba38-b7a7dce7ef68-kube-api-access-n8pkz\") pod \"node-ca-fjrnw\" (UID: \"05812575-ef7b-462f-ba38-b7a7dce7ef68\") " pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:31.956362 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.956337 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bshk\" (UniqueName: \"kubernetes.io/projected/b175a52e-2c98-4890-a694-c9e95cbc6c1b-kube-api-access-2bshk\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:31.956563 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.956541 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrbj7\" (UniqueName: \"kubernetes.io/projected/5027701b-787f-4cf2-a44e-6812631aadae-kube-api-access-rrbj7\") pod \"multus-additional-cni-plugins-dj4jg\" (UID: \"5027701b-787f-4cf2-a44e-6812631aadae\") " pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:31.957400 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:31.957384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv9hk\" (UniqueName: \"kubernetes.io/projected/8bd5f058-6082-42ac-b68c-3628d3155efd-kube-api-access-pv9hk\") pod \"aws-ebs-csi-driver-node-gndtq\" (UID: \"8bd5f058-6082-42ac-b68c-3628d3155efd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:32.042636 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/437ff35e-8d5f-4369-adf1-7a06710422b6-cni-binary-copy\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.042636 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-hostroot\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.042831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-cnibin\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.042831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9fede43d-c065-4ba5-8d6e-6c504e6754aa-dbus\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:32.042831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-hostroot\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.042831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-conf-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.042831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-conf-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.042831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-os-release\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042829 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-cnibin\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-etc-kubernetes\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042915 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-os-release\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61af6460-42b8-47d5-babf-3e03a677d893-host-slash\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:32.043079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042940 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9fede43d-c065-4ba5-8d6e-6c504e6754aa-dbus\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:32.043079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.042974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-etc-kubernetes\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61af6460-42b8-47d5-babf-3e03a677d893-host-slash\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:32.043079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhnkj\" (UniqueName: \"kubernetes.io/projected/61af6460-42b8-47d5-babf-3e03a677d893-kube-api-access-hhnkj\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-cni-bin\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-tmp-dir\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-cni-bin\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-socket-dir-parent\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-cni-multus\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.043269 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/437ff35e-8d5f-4369-adf1-7a06710422b6-cni-binary-copy\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-daemon-config\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9fede43d-c065-4ba5-8d6e-6c504e6754aa-kubelet-config\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043325 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-cni-multus\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.043339 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret podName:9fede43d-c065-4ba5-8d6e-6c504e6754aa nodeName:}" failed. No retries permitted until 2026-07-06 22:27:32.543321183 +0000 UTC m=+3.058960789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret") pod "global-pull-secret-syncer-9p5mm" (UID: "9fede43d-c065-4ba5-8d6e-6c504e6754aa") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-socket-dir-parent\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.043437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9fede43d-c065-4ba5-8d6e-6c504e6754aa-kubelet-config\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5w2s\" (UniqueName: \"kubernetes.io/projected/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-kube-api-access-v5w2s\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-system-cni-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-multus-certs\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043457 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-tmp-dir\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-cni-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-system-cni-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-multus-certs\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61af6460-42b8-47d5-babf-3e03a677d893-iptables-alerter-script\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-cni-dir\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-hosts-file\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-k8s-cni-cncf-io\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmrjw\" (UniqueName: \"kubernetes.io/projected/437ff35e-8d5f-4369-adf1-7a06710422b6-kube-api-access-rmrjw\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-hosts-file\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:32.044113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-netns\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044574 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-k8s-cni-cncf-io\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044574 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043717 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-run-netns\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044574 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043766 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/437ff35e-8d5f-4369-adf1-7a06710422b6-multus-daemon-config\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044574 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-kubelet\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044574 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.043868 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/437ff35e-8d5f-4369-adf1-7a06710422b6-host-var-lib-kubelet\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.044574 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.044041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/61af6460-42b8-47d5-babf-3e03a677d893-iptables-alerter-script\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:32.049447 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.049429 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:27:32.049526 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.049452 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:27:32.049526 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.049463 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7k5xb for pod openshift-network-diagnostics/network-check-target-bxv7s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:32.049636 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.049525 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb podName:15a56041-14d0-4edc-854e-8efabfc3804b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:32.549507268 +0000 UTC m=+3.065146868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7k5xb" (UniqueName: "kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb") pod "network-check-target-bxv7s" (UID: "15a56041-14d0-4edc-854e-8efabfc3804b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:32.051757 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.051728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5w2s\" (UniqueName: \"kubernetes.io/projected/ce5521f0-f29c-412c-b9d7-7d957d94c2b4-kube-api-access-v5w2s\") pod \"node-resolver-grtsn\" (UID: \"ce5521f0-f29c-412c-b9d7-7d957d94c2b4\") " pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:32.051757 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.051743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmrjw\" (UniqueName: \"kubernetes.io/projected/437ff35e-8d5f-4369-adf1-7a06710422b6-kube-api-access-rmrjw\") pod \"multus-hpr82\" (UID: \"437ff35e-8d5f-4369-adf1-7a06710422b6\") " pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.051916 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.051759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhnkj\" (UniqueName: \"kubernetes.io/projected/61af6460-42b8-47d5-babf-3e03a677d893-kube-api-access-hhnkj\") pod \"iptables-alerter-759g8\" (UID: \"61af6460-42b8-47d5-babf-3e03a677d893\") " pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:32.072482 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.072458 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea9d108671560738be1beffe7846653.slice/crio-3aafa2d0dd2fa9a72d0faf78cbb406d8a3064b5a5b01c91e06fed17fe48e52d2 WatchSource:0}: Error finding container 3aafa2d0dd2fa9a72d0faf78cbb406d8a3064b5a5b01c91e06fed17fe48e52d2: Status 404 returned error can't find the container with id 3aafa2d0dd2fa9a72d0faf78cbb406d8a3064b5a5b01c91e06fed17fe48e52d2 Jul 06 22:27:32.080363 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.080344 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:27:32.083932 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.083910 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeeede9dcebf30c4ff3bef4de55e4fed.slice/crio-dd9e61d24ab9713911af52406ddbc40b3cd1a1b265746640124f8c411df6a6bc WatchSource:0}: Error finding container dd9e61d24ab9713911af52406ddbc40b3cd1a1b265746640124f8c411df6a6bc: Status 404 returned error can't find the container with id dd9e61d24ab9713911af52406ddbc40b3cd1a1b265746640124f8c411df6a6bc Jul 06 22:27:32.133273 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.133247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fjrnw" Jul 06 22:27:32.141802 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.141779 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05812575_ef7b_462f_ba38_b7a7dce7ef68.slice/crio-f715fa68f60fbcd36d0209971072ababec3b9f3cc828ecf746c9e45342115003 WatchSource:0}: Error finding container f715fa68f60fbcd36d0209971072ababec3b9f3cc828ecf746c9e45342115003: Status 404 returned error can't find the container with id f715fa68f60fbcd36d0209971072ababec3b9f3cc828ecf746c9e45342115003 Jul 06 22:27:32.151132 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.151112 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" Jul 06 22:27:32.160366 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.160348 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5027701b_787f_4cf2_a44e_6812631aadae.slice/crio-d9bce09079ae82004a0e1b687e6ca0bc9cf69bb7f1fb3c140b95a04fe019da2a WatchSource:0}: Error finding container d9bce09079ae82004a0e1b687e6ca0bc9cf69bb7f1fb3c140b95a04fe019da2a: Status 404 returned error can't find the container with id d9bce09079ae82004a0e1b687e6ca0bc9cf69bb7f1fb3c140b95a04fe019da2a Jul 06 22:27:32.167049 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.167022 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" Jul 06 22:27:32.176442 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.176404 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd5f058_6082_42ac_b68c_3628d3155efd.slice/crio-8a58100d2b4f1c1824cfccd6e04eb7eb0d061aa0fe9ff1df6660a18c6117b18e WatchSource:0}: Error finding container 8a58100d2b4f1c1824cfccd6e04eb7eb0d061aa0fe9ff1df6660a18c6117b18e: Status 404 returned error can't find the container with id 8a58100d2b4f1c1824cfccd6e04eb7eb0d061aa0fe9ff1df6660a18c6117b18e Jul 06 22:27:32.184461 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.184443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9szvq" Jul 06 22:27:32.192279 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.192258 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da43f95_f768_4b34_9ef4_fd282cf45918.slice/crio-d0a8ff7ff82c4c800a3ddccecb0cd8300b1fa56ca78eaca432d9f9a2e2711112 WatchSource:0}: Error finding container d0a8ff7ff82c4c800a3ddccecb0cd8300b1fa56ca78eaca432d9f9a2e2711112: Status 404 returned error can't find the container with id d0a8ff7ff82c4c800a3ddccecb0cd8300b1fa56ca78eaca432d9f9a2e2711112 Jul 06 22:27:32.203240 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.203222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:32.205873 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.205848 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:32.212170 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.212147 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f84a1b_da72_45c1_9211_f643e5ffeca3.slice/crio-64bdb5940d1e36595e7667a8a8d6ed7df2493aae034c9f9c3aa0c846b338de15 WatchSource:0}: Error finding container 64bdb5940d1e36595e7667a8a8d6ed7df2493aae034c9f9c3aa0c846b338de15: Status 404 returned error can't find the container with id 64bdb5940d1e36595e7667a8a8d6ed7df2493aae034c9f9c3aa0c846b338de15 Jul 06 22:27:32.214807 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.214788 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4ddf05_5296_4df5_a1de_fddb9a7a2726.slice/crio-b7db2bccf020ec97d1a6d5f2ee4a59d5c1c3c0be19881ef3e08715af69707f16 WatchSource:0}: Error finding container b7db2bccf020ec97d1a6d5f2ee4a59d5c1c3c0be19881ef3e08715af69707f16: Status 404 returned error can't find the container with id b7db2bccf020ec97d1a6d5f2ee4a59d5c1c3c0be19881ef3e08715af69707f16 Jul 06 22:27:32.229046 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.229027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-grtsn" Jul 06 22:27:32.237940 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.237921 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5521f0_f29c_412c_b9d7_7d957d94c2b4.slice/crio-eb10ba929ec269d7cc6c23f89d892c2a0b00f795bd6d2e3cf2375975f66f17e2 WatchSource:0}: Error finding container eb10ba929ec269d7cc6c23f89d892c2a0b00f795bd6d2e3cf2375975f66f17e2: Status 404 returned error can't find the container with id eb10ba929ec269d7cc6c23f89d892c2a0b00f795bd6d2e3cf2375975f66f17e2 Jul 06 22:27:32.244958 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.244940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hpr82" Jul 06 22:27:32.253305 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.253283 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437ff35e_8d5f_4369_adf1_7a06710422b6.slice/crio-63d636e37b79423915293585a61a9e910d1d6608c70a4eda744327c04c0977ed WatchSource:0}: Error finding container 63d636e37b79423915293585a61a9e910d1d6608c70a4eda744327c04c0977ed: Status 404 returned error can't find the container with id 63d636e37b79423915293585a61a9e910d1d6608c70a4eda744327c04c0977ed Jul 06 22:27:32.266367 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.266349 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-759g8" Jul 06 22:27:32.275539 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:27:32.275519 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61af6460_42b8_47d5_babf_3e03a677d893.slice/crio-bcac03fed077e53ebdd448e8ff2812dd77485c07df4bdc710eb0acfaa932cb60 WatchSource:0}: Error finding container bcac03fed077e53ebdd448e8ff2812dd77485c07df4bdc710eb0acfaa932cb60: Status 404 returned error can't find the container with id bcac03fed077e53ebdd448e8ff2812dd77485c07df4bdc710eb0acfaa932cb60 Jul 06 22:27:32.277068 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.277049 2577 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-759g8_openshift-network-operator(61af6460-42b8-47d5-babf-3e03a677d893): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 06 22:27:32.277119 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.277083 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-759g8" podUID="61af6460-42b8-47d5-babf-3e03a677d893" Jul 06 22:27:32.447739 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.447675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:32.447839 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.447774 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:32.447839 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.447817 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs podName:b175a52e-2c98-4890-a694-c9e95cbc6c1b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:33.44780449 +0000 UTC m=+3.963444073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs") pod "network-metrics-daemon-5zvtm" (UID: "b175a52e-2c98-4890-a694-c9e95cbc6c1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:32.548861 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.548835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:32.548994 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.548950 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:32.549057 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.549015 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret podName:9fede43d-c065-4ba5-8d6e-6c504e6754aa nodeName:}" failed. No retries permitted until 2026-07-06 22:27:33.54900201 +0000 UTC m=+4.064641594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret") pod "global-pull-secret-syncer-9p5mm" (UID: "9fede43d-c065-4ba5-8d6e-6c504e6754aa") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:32.649238 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.649204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:32.649473 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.649454 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:27:32.649558 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.649485 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:27:32.649558 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.649498 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7k5xb for pod openshift-network-diagnostics/network-check-target-bxv7s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:32.649558 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:32.649555 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb podName:15a56041-14d0-4edc-854e-8efabfc3804b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:33.649535886 +0000 UTC m=+4.165175485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k5xb" (UniqueName: "kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb") pod "network-check-target-bxv7s" (UID: "15a56041-14d0-4edc-854e-8efabfc3804b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:32.878059 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.877900 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:22:32 +0000 UTC" deadline="2028-04-16 20:33:44.424046002 +0000 UTC" Jul 06 22:27:32.878059 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:32.877987 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15598h6m11.546064098s" Jul 06 22:27:33.035658 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.035534 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-grtsn" event={"ID":"ce5521f0-f29c-412c-b9d7-7d957d94c2b4","Type":"ContainerStarted","Data":"eb10ba929ec269d7cc6c23f89d892c2a0b00f795bd6d2e3cf2375975f66f17e2"} Jul 06 22:27:33.043208 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.043172 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4dnm2" event={"ID":"dd4ddf05-5296-4df5-a1de-fddb9a7a2726","Type":"ContainerStarted","Data":"b7db2bccf020ec97d1a6d5f2ee4a59d5c1c3c0be19881ef3e08715af69707f16"} Jul 06 22:27:33.063993 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.062873 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"64bdb5940d1e36595e7667a8a8d6ed7df2493aae034c9f9c3aa0c846b338de15"} Jul 06 22:27:33.070450 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.070389 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" event={"ID":"8bd5f058-6082-42ac-b68c-3628d3155efd","Type":"ContainerStarted","Data":"8a58100d2b4f1c1824cfccd6e04eb7eb0d061aa0fe9ff1df6660a18c6117b18e"} Jul 06 22:27:33.078177 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.078142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerStarted","Data":"d9bce09079ae82004a0e1b687e6ca0bc9cf69bb7f1fb3c140b95a04fe019da2a"} Jul 06 22:27:33.087810 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.087781 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fjrnw" event={"ID":"05812575-ef7b-462f-ba38-b7a7dce7ef68","Type":"ContainerStarted","Data":"f715fa68f60fbcd36d0209971072ababec3b9f3cc828ecf746c9e45342115003"} Jul 06 22:27:33.094634 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.094572 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9szvq" event={"ID":"3da43f95-f768-4b34-9ef4-fd282cf45918","Type":"ContainerStarted","Data":"d0a8ff7ff82c4c800a3ddccecb0cd8300b1fa56ca78eaca432d9f9a2e2711112"} Jul 06 22:27:33.115568 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.115531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" event={"ID":"beeede9dcebf30c4ff3bef4de55e4fed","Type":"ContainerStarted","Data":"dd9e61d24ab9713911af52406ddbc40b3cd1a1b265746640124f8c411df6a6bc"} Jul 06 22:27:33.124304 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.124239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" event={"ID":"fea9d108671560738be1beffe7846653","Type":"ContainerStarted","Data":"3aafa2d0dd2fa9a72d0faf78cbb406d8a3064b5a5b01c91e06fed17fe48e52d2"} Jul 06 22:27:33.132231 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.132165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-759g8" event={"ID":"61af6460-42b8-47d5-babf-3e03a677d893","Type":"ContainerStarted","Data":"bcac03fed077e53ebdd448e8ff2812dd77485c07df4bdc710eb0acfaa932cb60"} Jul 06 22:27:33.135370 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.135332 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-759g8" podUID="61af6460-42b8-47d5-babf-3e03a677d893" Jul 06 22:27:33.142498 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.142467 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hpr82" event={"ID":"437ff35e-8d5f-4369-adf1-7a06710422b6","Type":"ContainerStarted","Data":"63d636e37b79423915293585a61a9e910d1d6608c70a4eda744327c04c0977ed"} Jul 06 22:27:33.463983 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.463898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:33.464172 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.464112 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:33.464257 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.464179 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs podName:b175a52e-2c98-4890-a694-c9e95cbc6c1b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:35.464157783 +0000 UTC m=+5.979797392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs") pod "network-metrics-daemon-5zvtm" (UID: "b175a52e-2c98-4890-a694-c9e95cbc6c1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:33.565042 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.564971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:33.565240 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.565149 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:33.565240 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.565215 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret podName:9fede43d-c065-4ba5-8d6e-6c504e6754aa nodeName:}" failed. No retries permitted until 2026-07-06 22:27:35.565195231 +0000 UTC m=+6.080834837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret") pod "global-pull-secret-syncer-9p5mm" (UID: "9fede43d-c065-4ba5-8d6e-6c504e6754aa") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:33.665995 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.665956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:33.666198 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.666175 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:27:33.666198 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.666195 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:27:33.666310 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.666208 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7k5xb for pod openshift-network-diagnostics/network-check-target-bxv7s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:33.666310 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:33.666273 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb podName:15a56041-14d0-4edc-854e-8efabfc3804b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:35.666250611 +0000 UTC m=+6.181890210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k5xb" (UniqueName: "kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb") pod "network-check-target-bxv7s" (UID: "15a56041-14d0-4edc-854e-8efabfc3804b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:33.879230 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.879113 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 22:22:32 +0000 UTC" deadline="2027-12-25 00:19:52.410628068 +0000 UTC" Jul 06 22:27:33.879230 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:33.879178 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12865h52m18.531453693s" Jul 06 22:27:34.018066 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:34.014891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:34.018066 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:34.015110 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:34.018066 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:34.014898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:34.018066 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:34.015142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:34.018066 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:34.015212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:34.018066 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:34.015316 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:35.482783 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:35.482743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:35.483430 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:35.482924 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:35.483430 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:35.483027 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs podName:b175a52e-2c98-4890-a694-c9e95cbc6c1b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:39.483000122 +0000 UTC m=+9.998639740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs") pod "network-metrics-daemon-5zvtm" (UID: "b175a52e-2c98-4890-a694-c9e95cbc6c1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:35.583708 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:35.583402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:35.583708 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:35.583604 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:35.583708 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:35.583671 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret podName:9fede43d-c065-4ba5-8d6e-6c504e6754aa nodeName:}" failed. No retries permitted until 2026-07-06 22:27:39.583651243 +0000 UTC m=+10.099290828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret") pod "global-pull-secret-syncer-9p5mm" (UID: "9fede43d-c065-4ba5-8d6e-6c504e6754aa") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:35.684794 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:35.684191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:35.684794 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:35.684441 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:27:35.684794 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:35.684469 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:27:35.684794 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:35.684485 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7k5xb for pod openshift-network-diagnostics/network-check-target-bxv7s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:35.684794 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:35.684558 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb podName:15a56041-14d0-4edc-854e-8efabfc3804b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:39.684536539 +0000 UTC m=+10.200176210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k5xb" (UniqueName: "kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb") pod "network-check-target-bxv7s" (UID: "15a56041-14d0-4edc-854e-8efabfc3804b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:36.015678 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:36.015644 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:36.015894 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:36.015652 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:36.015894 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:36.015798 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:36.015894 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:36.015803 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:36.016095 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:36.015897 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:36.016095 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:36.016009 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:38.015190 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:38.015063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:38.015716 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:38.015185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:38.015716 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:38.015195 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:38.015716 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:38.015322 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:38.015716 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:38.015358 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:38.015716 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:38.015457 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:39.517448 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:39.517415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:39.517944 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:39.517558 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:39.517944 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:39.517636 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs podName:b175a52e-2c98-4890-a694-c9e95cbc6c1b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:47.517616028 +0000 UTC m=+18.033255631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs") pod "network-metrics-daemon-5zvtm" (UID: "b175a52e-2c98-4890-a694-c9e95cbc6c1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:39.618280 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:39.618224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:39.618470 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:39.618356 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:39.618470 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:39.618425 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret podName:9fede43d-c065-4ba5-8d6e-6c504e6754aa nodeName:}" failed. No retries permitted until 2026-07-06 22:27:47.618404947 +0000 UTC m=+18.134044549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret") pod "global-pull-secret-syncer-9p5mm" (UID: "9fede43d-c065-4ba5-8d6e-6c504e6754aa") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:39.718967 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:39.718931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:39.719157 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:39.719126 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:27:39.719157 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:39.719147 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:27:39.719157 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:39.719160 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7k5xb for pod openshift-network-diagnostics/network-check-target-bxv7s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:39.719335 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:39.719233 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb podName:15a56041-14d0-4edc-854e-8efabfc3804b nodeName:}" failed. No retries permitted until 2026-07-06 22:27:47.719210152 +0000 UTC m=+18.234849762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k5xb" (UniqueName: "kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb") pod "network-check-target-bxv7s" (UID: "15a56041-14d0-4edc-854e-8efabfc3804b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:40.015017 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:40.014927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:40.015180 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:40.015076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:40.015180 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:40.015088 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:40.015308 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:40.015200 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:40.015308 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:40.015243 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:40.015404 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:40.015324 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:42.015501 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:42.015363 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:42.015501 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:42.015379 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:42.015501 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:42.015494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:42.015501 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:42.015493 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:42.016174 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:42.015608 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:42.016174 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:42.015692 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:44.015736 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:44.015704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:44.016178 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:44.015737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:44.016178 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:44.015840 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:44.016296 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:44.016267 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:44.019688 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:44.016827 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:44.019688 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:44.017082 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:46.015353 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:46.015322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:46.015807 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:46.015328 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:46.015807 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:46.015449 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:46.015807 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:46.015477 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:46.015807 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:46.015564 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:46.015807 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:46.015669 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:47.582001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:47.581966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:47.582380 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:47.582051 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:47.582380 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:47.582113 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs podName:b175a52e-2c98-4890-a694-c9e95cbc6c1b nodeName:}" failed. No retries permitted until 2026-07-06 22:28:03.582094885 +0000 UTC m=+34.097734483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs") pod "network-metrics-daemon-5zvtm" (UID: "b175a52e-2c98-4890-a694-c9e95cbc6c1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:27:47.682463 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:47.682433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:47.682600 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:47.682582 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:47.682674 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:47.682646 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret podName:9fede43d-c065-4ba5-8d6e-6c504e6754aa nodeName:}" failed. No retries permitted until 2026-07-06 22:28:03.682626311 +0000 UTC m=+34.198265893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret") pod "global-pull-secret-syncer-9p5mm" (UID: "9fede43d-c065-4ba5-8d6e-6c504e6754aa") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:27:47.783658 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:47.783627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:47.783822 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:47.783773 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:27:47.783822 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:47.783795 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:27:47.783822 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:47.783807 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7k5xb for pod openshift-network-diagnostics/network-check-target-bxv7s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:47.783996 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:47.783867 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb podName:15a56041-14d0-4edc-854e-8efabfc3804b nodeName:}" failed. No retries permitted until 2026-07-06 22:28:03.783846875 +0000 UTC m=+34.299486477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k5xb" (UniqueName: "kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb") pod "network-check-target-bxv7s" (UID: "15a56041-14d0-4edc-854e-8efabfc3804b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:27:48.014898 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:48.014869 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:48.014898 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:48.014880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:48.015105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:48.014882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:48.015105 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:48.014992 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:48.015203 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:48.015102 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:48.015203 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:48.015181 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:50.015771 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:50.015738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:50.016227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:50.015787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:50.016227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:50.015735 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:50.016227 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:50.015872 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:50.016227 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:50.015938 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:50.016227 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:50.016063 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:52.015330 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:52.015297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:52.015727 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:52.015412 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:52.015727 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:52.015427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:52.015727 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:52.015424 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:52.015727 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:52.015500 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:52.015727 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:52.015566 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:53.193872 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.193469 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"3beab6d13d6745e0281bc92a0f484070d571fa5c02e647935e1df6b19973d9f6"} Jul 06 22:27:53.194371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.193967 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"8a1fc564654aba139c244f3f50197e112b18a5258b4c19914fa9cdea8aa81f30"} Jul 06 22:27:53.194371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.194030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"1bff644ac064bea0894f74a69517345b69aedf8041d6f3722b9619fda15b8ed9"} Jul 06 22:27:53.195836 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.195811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9szvq" event={"ID":"3da43f95-f768-4b34-9ef4-fd282cf45918","Type":"ContainerStarted","Data":"5d39d84acf9a391ecc7b7ed93a4246cdff1d804de4eaf9ffe84f83f0f65d9ddd"} Jul 06 22:27:53.197335 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.197316 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" event={"ID":"fea9d108671560738be1beffe7846653","Type":"ContainerStarted","Data":"28488fdf1140adf9b6726bc8fd066a4cdb3663ec73ff71ba81f91b10e27e59dc"} Jul 06 22:27:53.198547 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.198528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hpr82" event={"ID":"437ff35e-8d5f-4369-adf1-7a06710422b6","Type":"ContainerStarted","Data":"241996a9685db1ffadafac044960d26d75f625170b2c0a3233cfdb48810f557e"} Jul 06 22:27:53.212939 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.212888 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9szvq" podStartSLOduration=1.774421325 podStartE2EDuration="22.212869754s" totalImagesPullingTime="20.438448429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:53.212336928 +0000 UTC m=+23.727976532" watchObservedRunningTime="2026-07-06 22:27:53.212869754 +0000 UTC m=+23.728509359" Jul 06 22:27:53.229406 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.229371 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hpr82" podStartSLOduration=0.834790247 podStartE2EDuration="21.229359328s" totalImagesPullingTime="20.394569081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:53.228972799 +0000 UTC m=+23.744612404" watchObservedRunningTime="2026-07-06 22:27:53.229359328 +0000 UTC m=+23.744998931" Jul 06 22:27:53.241615 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:53.241581 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-3.ec2.internal" podStartSLOduration=21.241570009 podStartE2EDuration="21.241570009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:53.241413499 +0000 UTC m=+23.757053103" watchObservedRunningTime="2026-07-06 22:27:53.241570009 +0000 UTC m=+23.757209613" Jul 06 22:27:54.014939 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.014906 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:54.015096 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.014945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:54.015096 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.015014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:54.015096 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:54.015024 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:54.015096 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:54.015073 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:54.015278 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:54.015186 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:54.202761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.202690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-759g8" event={"ID":"61af6460-42b8-47d5-babf-3e03a677d893","Type":"ContainerStarted","Data":"d0e88c5290f9e850f6fce2c5dd3f10b8f0699e7da736fa5f296a9ce253c57bb2"} Jul 06 22:27:54.204498 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.204465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-grtsn" event={"ID":"ce5521f0-f29c-412c-b9d7-7d957d94c2b4","Type":"ContainerStarted","Data":"26db9dc5d2f4deab76fb4723ff72960488c0a5afb43080ae8416f3bbc0180012"} Jul 06 22:27:54.205998 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.205966 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4dnm2" event={"ID":"dd4ddf05-5296-4df5-a1de-fddb9a7a2726","Type":"ContainerStarted","Data":"53c9a1758c7a1938c453df356a851406c137d4bca761b979fbfb4a38fd2a630e"} Jul 06 22:27:54.209340 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.209315 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"7bca7ebfda5745c9a6783f72f6d30684ce8a5a1f007b31df95e0fcf2dff78ce2"} Jul 06 22:27:54.209442 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.209392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"02d0b78607a94d6780e310875e9c149d1b55d1929c154d8d7209caf311f16dce"} Jul 06 22:27:54.209501 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.209443 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"2ff6225ae5953e550159f438a13407dfd6e336862de699bfb20950d452c8baa8"} Jul 06 22:27:54.211003 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.210979 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" event={"ID":"8bd5f058-6082-42ac-b68c-3628d3155efd","Type":"ContainerStarted","Data":"cb11d0d49e26306ca044e79ed7070ff03a8f5afcd8de3627c3afdb763e89b696"} Jul 06 22:27:54.212614 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.212593 2577 generic.go:356] "Generic (PLEG): container finished" podID="5027701b-787f-4cf2-a44e-6812631aadae" containerID="b55f2fad6594e72c746e274dccdcea34e5cee1d05534949c458967236f8fa48e" exitCode=0 Jul 06 22:27:54.212715 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.212623 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerDied","Data":"b55f2fad6594e72c746e274dccdcea34e5cee1d05534949c458967236f8fa48e"} Jul 06 22:27:54.214291 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.214267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fjrnw" event={"ID":"05812575-ef7b-462f-ba38-b7a7dce7ef68","Type":"ContainerStarted","Data":"713dce27cb13d7e8a5ccfbbb3702bc351583ecb2b35d1f9644cc26a71da7404e"} Jul 06 22:27:54.216528 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.216502 2577 generic.go:356] "Generic (PLEG): container finished" podID="beeede9dcebf30c4ff3bef4de55e4fed" containerID="0abdfe2301ba763dbbf02a1ee238823e4493e5753d29c50a6154a8a7c4229b0f" exitCode=0 Jul 06 22:27:54.216631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.216609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" event={"ID":"beeede9dcebf30c4ff3bef4de55e4fed","Type":"ContainerDied","Data":"0abdfe2301ba763dbbf02a1ee238823e4493e5753d29c50a6154a8a7c4229b0f"} Jul 06 22:27:54.217837 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.217792 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-759g8" podStartSLOduration=22.217780033 podStartE2EDuration="22.217780033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 22:27:54.217231633 +0000 UTC m=+24.732871238" watchObservedRunningTime="2026-07-06 22:27:54.217780033 +0000 UTC m=+24.733419639" Jul 06 22:27:54.231032 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.230991 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fjrnw" podStartSLOduration=2.74362508 podStartE2EDuration="23.230973686s" totalImagesPullingTime="20.487348606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:54.230846733 +0000 UTC m=+24.746486337" watchObservedRunningTime="2026-07-06 22:27:54.230973686 +0000 UTC m=+24.746613286" Jul 06 22:27:54.263490 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.262909 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-grtsn" podStartSLOduration=1.870158346 podStartE2EDuration="22.262899361s" totalImagesPullingTime="20.392741015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:54.262401685 +0000 UTC m=+24.778041290" watchObservedRunningTime="2026-07-06 22:27:54.262899361 +0000 UTC m=+24.778538964" Jul 06 22:27:54.291381 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.291338 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4dnm2" podStartSLOduration=1.893367356 podStartE2EDuration="22.291318848s" totalImagesPullingTime="20.397951492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:54.290483159 +0000 UTC m=+24.806122764" watchObservedRunningTime="2026-07-06 22:27:54.291318848 +0000 UTC m=+24.806958452" Jul 06 22:27:54.343351 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.343320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:54.418641 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.418613 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:54.876946 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.876920 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 22:27:54.919755 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.919637 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T22:27:54.876943618Z","UUID":"2d08c162-3e31-4058-b451-11bc7b5f2bb3","Handler":null,"Name":"","Endpoint":""} Jul 06 22:27:54.921235 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.921201 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 22:27:54.921338 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:54.921243 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 22:27:55.220621 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:55.220545 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" event={"ID":"8bd5f058-6082-42ac-b68c-3628d3155efd","Type":"ContainerStarted","Data":"8310cb28824fd880bca6e6bbd15f8580044c057be937858c8149cd446eada9f5"} Jul 06 22:27:55.222679 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:55.222629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" event={"ID":"beeede9dcebf30c4ff3bef4de55e4fed","Type":"ContainerStarted","Data":"ef0d5eddcfe42ec96ef54f7593c817253787fd22c8825062da5167cf2a1ba98d"} Jul 06 22:27:55.238609 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:55.238568 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-3.ec2.internal" podStartSLOduration=23.238556504 podStartE2EDuration="23.238556504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:55.238142069 +0000 UTC m=+25.753781673" watchObservedRunningTime="2026-07-06 22:27:55.238556504 +0000 UTC m=+25.754196107" Jul 06 22:27:55.769634 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:55.769570 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:55.770157 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:55.770135 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:56.015709 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:56.015684 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:56.015820 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:56.015689 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:56.015820 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:56.015806 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:56.015922 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:56.015813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:56.015977 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:56.015911 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:56.016050 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:56.016028 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:56.227520 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:56.227444 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"81b662cb6fe843fa1a3a3f9d2d843b0b869502056b623b56a533307e62a205c9"} Jul 06 22:27:56.229368 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:56.229342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" event={"ID":"8bd5f058-6082-42ac-b68c-3628d3155efd","Type":"ContainerStarted","Data":"6c52715fd05aa62972ea82a23634e5a8b6b2e404d20bb9f089ff60864f5a44d7"} Jul 06 22:27:56.247738 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:56.247698 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gndtq" podStartSLOduration=2.581873422 podStartE2EDuration="25.24768428s" totalImagesPullingTime="22.665810858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:56.247613568 +0000 UTC m=+26.763253173" watchObservedRunningTime="2026-07-06 22:27:56.24768428 +0000 UTC m=+26.763323884" Jul 06 22:27:57.231803 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:57.231773 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 22:27:57.882889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:57.882679 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:57.942112 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:57.942075 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:58.015353 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:58.015329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:58.015353 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:58.015346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:58.015580 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:58.015433 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:27:58.015580 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:58.015332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:58.015580 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:58.015536 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:58.015722 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:58.015628 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:58.236776 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:58.236710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" event={"ID":"38f84a1b-da72-45c1-9211-f643e5ffeca3","Type":"ContainerStarted","Data":"3697da0486b67d21dbcb3d060dafdf6e14e271220c54f87b78c1637a61b80e0a"} Jul 06 22:27:58.237213 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:58.236925 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:58.251726 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:58.251701 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:58.264613 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:58.264559 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" podStartSLOduration=5.748050069 podStartE2EDuration="26.264544886s" totalImagesPullingTime="20.516494817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:27:58.264030733 +0000 UTC m=+28.779670338" watchObservedRunningTime="2026-07-06 22:27:58.264544886 +0000 UTC m=+28.780184510" Jul 06 22:27:59.240186 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.240156 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:59.240777 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.240234 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:59.255562 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.255535 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:27:59.303204 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.303165 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:59.389646 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.389614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:59.427432 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.427392 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:59.427604 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.427589 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 22:27:59.428252 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.428229 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4dnm2" Jul 06 22:27:59.448868 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.448839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:59.504453 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.504384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:27:59.663771 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.663740 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bxv7s"] Jul 06 22:27:59.663944 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.663872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:27:59.664059 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:59.664024 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:27:59.664618 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.664533 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9p5mm"] Jul 06 22:27:59.664711 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.664628 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:27:59.664766 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:59.664715 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:27:59.665591 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.665568 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5zvtm"] Jul 06 22:27:59.665665 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:27:59.665658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:27:59.665757 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:27:59.665741 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:28:00.244328 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:00.244299 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerStarted","Data":"c1f0a034c39ccaf43e2d4ac285e499e87273cc409e02b0a184b1cb796a5aabe3"} Jul 06 22:28:00.326348 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:00.326322 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:00.426925 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:00.426868 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:01.020309 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:01.020281 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:01.118298 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:01.118260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:01.247421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:01.247394 2577 generic.go:356] "Generic (PLEG): container finished" podID="5027701b-787f-4cf2-a44e-6812631aadae" containerID="c1f0a034c39ccaf43e2d4ac285e499e87273cc409e02b0a184b1cb796a5aabe3" exitCode=0 Jul 06 22:28:01.247774 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:01.247480 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerDied","Data":"c1f0a034c39ccaf43e2d4ac285e499e87273cc409e02b0a184b1cb796a5aabe3"} Jul 06 22:28:01.270880 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:01.270768 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:02.015526 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:02.015442 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:28:02.015674 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:02.015530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:28:02.015746 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:02.015665 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:28:02.015746 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:02.015705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:02.015844 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:02.015783 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:28:02.016050 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:02.016012 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:28:02.145321 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:02.145288 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:02.247798 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:02.247763 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:02.250877 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:02.250854 2577 generic.go:356] "Generic (PLEG): container finished" podID="5027701b-787f-4cf2-a44e-6812631aadae" containerID="5776a6732aaba9c1c047be327c5bb2d8cfc9b1e8bf2488549e95012c158fbff5" exitCode=0 Jul 06 22:28:02.250987 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:02.250898 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerDied","Data":"5776a6732aaba9c1c047be327c5bb2d8cfc9b1e8bf2488549e95012c158fbff5"} Jul 06 22:28:03.057735 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:03.057715 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grtsn_ce5521f0-f29c-412c-b9d7-7d957d94c2b4/dns-node-resolver/0.log" Jul 06 22:28:03.255349 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:03.255274 2577 generic.go:356] "Generic (PLEG): container finished" podID="5027701b-787f-4cf2-a44e-6812631aadae" containerID="7a77508072c87030289bcf2994b140abbdaa918e37279aa7de70758a8eab5e39" exitCode=0 Jul 06 22:28:03.255349 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:03.255319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerDied","Data":"7a77508072c87030289bcf2994b140abbdaa918e37279aa7de70758a8eab5e39"} Jul 06 22:28:03.610568 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:03.610493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:28:03.610684 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:03.610627 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:28:03.610684 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:03.610681 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs podName:b175a52e-2c98-4890-a694-c9e95cbc6c1b nodeName:}" failed. No retries permitted until 2026-07-06 22:28:35.610665709 +0000 UTC m=+66.126305294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs") pod "network-metrics-daemon-5zvtm" (UID: "b175a52e-2c98-4890-a694-c9e95cbc6c1b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 22:28:03.711701 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:03.711673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:28:03.711825 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:03.711790 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 22:28:03.711876 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:03.711837 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret podName:9fede43d-c065-4ba5-8d6e-6c504e6754aa nodeName:}" failed. No retries permitted until 2026-07-06 22:28:35.711822813 +0000 UTC m=+66.227462396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret") pod "global-pull-secret-syncer-9p5mm" (UID: "9fede43d-c065-4ba5-8d6e-6c504e6754aa") : object "kube-system"/"original-pull-secret" not registered Jul 06 22:28:03.811885 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:03.811858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:03.812009 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:03.811993 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 22:28:03.812009 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:03.812008 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 22:28:03.812086 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:03.812017 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7k5xb for pod openshift-network-diagnostics/network-check-target-bxv7s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:28:03.812086 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:03.812053 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb podName:15a56041-14d0-4edc-854e-8efabfc3804b nodeName:}" failed. No retries permitted until 2026-07-06 22:28:35.812042152 +0000 UTC m=+66.327681734 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7k5xb" (UniqueName: "kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb") pod "network-check-target-bxv7s" (UID: "15a56041-14d0-4edc-854e-8efabfc3804b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 22:28:04.015001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:04.014913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:04.015141 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:04.015047 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:28:04.015141 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:04.015085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:28:04.015141 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:04.015119 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:28:04.015261 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:04.015190 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:28:04.015298 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:04.015283 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:28:04.059030 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:04.059008 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fjrnw_05812575-ef7b-462f-ba38-b7a7dce7ef68/node-ca/0.log" Jul 06 22:28:06.014960 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.014927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:28:06.015410 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.014926 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:06.015410 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.015050 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9p5mm" podUID="9fede43d-c065-4ba5-8d6e-6c504e6754aa" Jul 06 22:28:06.015410 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.015096 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bxv7s" podUID="15a56041-14d0-4edc-854e-8efabfc3804b" Jul 06 22:28:06.015410 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.014927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:28:06.015410 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.015191 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5zvtm" podUID="b175a52e-2c98-4890-a694-c9e95cbc6c1b" Jul 06 22:28:06.202270 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.202242 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-3.ec2.internal" event="NodeReady" Jul 06 22:28:06.202420 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.202378 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 22:28:06.249449 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.249424 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x9f4s"] Jul 06 22:28:06.252246 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.252224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.252628 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.252611 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sd79s"] Jul 06 22:28:06.254170 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.254147 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z9fkj\"" Jul 06 22:28:06.254273 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.254242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 22:28:06.254527 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.254509 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 22:28:06.255350 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.255333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sd79s" Jul 06 22:28:06.258264 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.258245 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 22:28:06.258363 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.258266 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 22:28:06.258363 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.258268 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mvrsx\"" Jul 06 22:28:06.258363 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.258305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 22:28:06.261808 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.261789 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9f4s"] Jul 06 22:28:06.265906 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.265857 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sd79s"] Jul 06 22:28:06.275392 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.275371 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pv4fl"] Jul 06 22:28:06.279329 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.279288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.282117 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.282098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 22:28:06.282211 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.282153 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 22:28:06.282269 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.282246 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 22:28:06.282342 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.282324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mcxxp\"" Jul 06 22:28:06.282404 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.282356 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 22:28:06.288565 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.288546 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pv4fl"] Jul 06 22:28:06.385275 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.385072 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:06.431043 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj2cp\" (UniqueName: \"kubernetes.io/projected/d2c61271-8422-4b25-b7c8-a128bd188946-kube-api-access-sj2cp\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.431180 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.431180 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k72f\" (UniqueName: \"kubernetes.io/projected/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-api-access-9k72f\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.431180 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca36c93c-ba5a-44da-b1bd-326edff908da-data-volume\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.431180 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5gbz\" (UniqueName: \"kubernetes.io/projected/3293b7a8-e16f-45e1-9657-62b1bac7bd29-kube-api-access-f5gbz\") pod \"ingress-canary-sd79s\" (UID: \"3293b7a8-e16f-45e1-9657-62b1bac7bd29\") " pod="openshift-ingress-canary/ingress-canary-sd79s" Jul 06 22:28:06.431394 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca36c93c-ba5a-44da-b1bd-326edff908da-crio-socket\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.431394 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.431394 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.431394 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3293b7a8-e16f-45e1-9657-62b1bac7bd29-cert\") pod \"ingress-canary-sd79s\" (UID: \"3293b7a8-e16f-45e1-9657-62b1bac7bd29\") " pod="openshift-ingress-canary/ingress-canary-sd79s" Jul 06 22:28:06.431394 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2c61271-8422-4b25-b7c8-a128bd188946-config-volume\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.431394 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.431371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c61271-8422-4b25-b7c8-a128bd188946-tmp-dir\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.485618 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.485587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:06.532570 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c61271-8422-4b25-b7c8-a128bd188946-tmp-dir\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.532570 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj2cp\" (UniqueName: \"kubernetes.io/projected/d2c61271-8422-4b25-b7c8-a128bd188946-kube-api-access-sj2cp\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k72f\" (UniqueName: \"kubernetes.io/projected/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-api-access-9k72f\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca36c93c-ba5a-44da-b1bd-326edff908da-data-volume\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5gbz\" (UniqueName: \"kubernetes.io/projected/3293b7a8-e16f-45e1-9657-62b1bac7bd29-kube-api-access-f5gbz\") pod \"ingress-canary-sd79s\" (UID: \"3293b7a8-e16f-45e1-9657-62b1bac7bd29\") " pod="openshift-ingress-canary/ingress-canary-sd79s" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca36c93c-ba5a-44da-b1bd-326edff908da-crio-socket\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.532678 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3293b7a8-e16f-45e1-9657-62b1bac7bd29-cert\") pod \"ingress-canary-sd79s\" (UID: \"3293b7a8-e16f-45e1-9657-62b1bac7bd29\") " pod="openshift-ingress-canary/ingress-canary-sd79s" Jul 06 22:28:06.532761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.532749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2c61271-8422-4b25-b7c8-a128bd188946-config-volume\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.533208 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.532781 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:07.032755695 +0000 UTC m=+37.548395296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : configmap "kube-rbac-proxy" not found Jul 06 22:28:06.533208 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.533089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca36c93c-ba5a-44da-b1bd-326edff908da-crio-socket\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.533208 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.533114 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:28:06.533208 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.533161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c61271-8422-4b25-b7c8-a128bd188946-tmp-dir\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.533208 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.533174 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:07.033156353 +0000 UTC m=+37.548795939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : secret "insights-runtime-extractor-tls" not found Jul 06 22:28:06.533455 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.533253 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:28:06.533455 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:06.533313 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls podName:d2c61271-8422-4b25-b7c8-a128bd188946 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:07.033296128 +0000 UTC m=+37.548935727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls") pod "dns-default-x9f4s" (UID: "d2c61271-8422-4b25-b7c8-a128bd188946") : secret "dns-default-metrics-tls" not found Jul 06 22:28:06.533455 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.533391 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d2c61271-8422-4b25-b7c8-a128bd188946-config-volume\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.533455 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.533396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca36c93c-ba5a-44da-b1bd-326edff908da-data-volume\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.537787 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.537765 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3293b7a8-e16f-45e1-9657-62b1bac7bd29-cert\") pod \"ingress-canary-sd79s\" (UID: \"3293b7a8-e16f-45e1-9657-62b1bac7bd29\") " pod="openshift-ingress-canary/ingress-canary-sd79s" Jul 06 22:28:06.542139 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.542108 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k72f\" (UniqueName: \"kubernetes.io/projected/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-api-access-9k72f\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:06.542568 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.542547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj2cp\" (UniqueName: \"kubernetes.io/projected/d2c61271-8422-4b25-b7c8-a128bd188946-kube-api-access-sj2cp\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:06.542924 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.542907 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5gbz\" (UniqueName: \"kubernetes.io/projected/3293b7a8-e16f-45e1-9657-62b1bac7bd29-kube-api-access-f5gbz\") pod \"ingress-canary-sd79s\" (UID: \"3293b7a8-e16f-45e1-9657-62b1bac7bd29\") " pod="openshift-ingress-canary/ingress-canary-sd79s" Jul 06 22:28:06.568465 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:06.568434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sd79s" Jul 06 22:28:07.037132 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.037106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:07.037590 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:07.037254 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:28:07.037590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.037268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:07.037590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.037313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:07.037590 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:07.037364 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls podName:d2c61271-8422-4b25-b7c8-a128bd188946 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:08.037345546 +0000 UTC m=+38.552985128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls") pod "dns-default-x9f4s" (UID: "d2c61271-8422-4b25-b7c8-a128bd188946") : secret "dns-default-metrics-tls" not found Jul 06 22:28:07.037590 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:07.037393 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:28:07.037590 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:07.037422 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:28:07.037590 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:07.037481 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:08.037448481 +0000 UTC m=+38.553088077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : configmap "kube-rbac-proxy" not found Jul 06 22:28:07.037590 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:07.037510 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:08.037491507 +0000 UTC m=+38.553131122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : secret "insights-runtime-extractor-tls" not found Jul 06 22:28:07.351966 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.351863 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:07.451607 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.451568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:07.788150 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.788078 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz"] Jul 06 22:28:07.806193 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.806154 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz"] Jul 06 22:28:07.806333 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.806276 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:07.808997 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.808815 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 22:28:07.808997 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.808825 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 22:28:07.808997 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.808836 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2ldt9\"" Jul 06 22:28:07.808997 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.808856 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:28:07.809270 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.809023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 22:28:07.826229 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.826208 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz" Jul 06 22:28:07.826337 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.826227 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz"] Jul 06 22:28:07.826337 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.826271 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz"] Jul 06 22:28:07.828425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.828404 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:28:07.828526 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.828459 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 22:28:07.828526 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.828461 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fnh5t\"" Jul 06 22:28:07.890406 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.890376 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv"] Jul 06 22:28:07.906157 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.906133 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x"] Jul 06 22:28:07.906281 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.906257 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:07.908938 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.908916 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 22:28:07.909315 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.909156 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 22:28:07.909315 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.909181 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:28:07.909484 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.909458 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 22:28:07.910707 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.910365 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qpllj\"" Jul 06 22:28:07.920168 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.920150 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-f225l"] Jul 06 22:28:07.920275 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.920260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:07.922605 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.922584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 22:28:07.922706 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.922610 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l6qdm\"" Jul 06 22:28:07.922867 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.922849 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 22:28:07.923084 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.923063 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:28:07.938413 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.938395 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv"] Jul 06 22:28:07.938547 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.938431 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x"] Jul 06 22:28:07.938547 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.938457 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-f225l"] Jul 06 22:28:07.938547 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.938516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:07.940938 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.940918 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 22:28:07.941047 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.940979 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kq75s\"" Jul 06 22:28:07.941047 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.940991 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 22:28:07.941158 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.941071 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 22:28:07.941253 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.941234 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 22:28:07.944387 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.944367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k9xv\" (UniqueName: \"kubernetes.io/projected/cab84536-bacb-4d98-9113-c56f55190ef0-kube-api-access-8k9xv\") pod \"volume-data-source-validator-5d456fdbcd-8dxsz\" (UID: \"cab84536-bacb-4d98-9113-c56f55190ef0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz" Jul 06 22:28:07.944485 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.944408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c17a2bef-e938-44e1-9227-049e597e25b7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:07.944550 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.944496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c17a2bef-e938-44e1-9227-049e597e25b7-config\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:07.944550 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.944523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbdxz\" (UniqueName: \"kubernetes.io/projected/c17a2bef-e938-44e1-9227-049e597e25b7-kube-api-access-qbdxz\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:07.946145 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:07.946101 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 22:28:08.015214 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.015183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:28:08.015383 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.015190 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:28:08.015454 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.015190 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:08.018009 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.017986 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:28:08.018118 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.018013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:28:08.018191 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.018117 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 22:28:08.018191 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.018117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-69kbf\"" Jul 06 22:28:08.018385 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.018369 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 22:28:08.018431 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.018395 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kgqgb\"" Jul 06 22:28:08.045614 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba1f3831-e11d-477f-85d5-e0330cc02f05-config\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.045614 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.045708 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.045718 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba1f3831-e11d-477f-85d5-e0330cc02f05-trusted-ca\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.045756 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls podName:d2c61271-8422-4b25-b7c8-a128bd188946 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:10.0457429 +0000 UTC m=+40.561382502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls") pod "dns-default-x9f4s" (UID: "d2c61271-8422-4b25-b7c8-a128bd188946") : secret "dns-default-metrics-tls" not found Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.045768 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:10.045762411 +0000 UTC m=+40.561401993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : secret "insights-runtime-extractor-tls" not found Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k9xv\" (UniqueName: \"kubernetes.io/projected/cab84536-bacb-4d98-9113-c56f55190ef0-kube-api-access-8k9xv\") pod \"volume-data-source-validator-5d456fdbcd-8dxsz\" (UID: \"cab84536-bacb-4d98-9113-c56f55190ef0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz" Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7672\" (UniqueName: \"kubernetes.io/projected/ba1f3831-e11d-477f-85d5-e0330cc02f05-kube-api-access-n7672\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c17a2bef-e938-44e1-9227-049e597e25b7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dff7a4cb-8915-4940-ba8a-5239effff1e4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.045982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dff7a4cb-8915-4940-ba8a-5239effff1e4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.046456 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.045971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r8kj\" (UniqueName: \"kubernetes.io/projected/99e76c88-587d-4adb-8b2d-045454871513-kube-api-access-2r8kj\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:08.046456 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.046114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1f3831-e11d-477f-85d5-e0330cc02f05-serving-cert\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.046456 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.046153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c17a2bef-e938-44e1-9227-049e597e25b7-config\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:08.046456 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.046185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbdxz\" (UniqueName: \"kubernetes.io/projected/c17a2bef-e938-44e1-9227-049e597e25b7-kube-api-access-qbdxz\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:08.046456 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.046309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:08.046456 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.046340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxw7l\" (UniqueName: \"kubernetes.io/projected/dff7a4cb-8915-4940-ba8a-5239effff1e4-kube-api-access-vxw7l\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.046456 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.046427 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:28:08.046655 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.046487 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:10.046471357 +0000 UTC m=+40.562110955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : configmap "kube-rbac-proxy" not found Jul 06 22:28:08.046691 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.046674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c17a2bef-e938-44e1-9227-049e597e25b7-config\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:08.048084 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.048066 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c17a2bef-e938-44e1-9227-049e597e25b7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:08.053692 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.053669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbdxz\" (UniqueName: \"kubernetes.io/projected/c17a2bef-e938-44e1-9227-049e597e25b7-kube-api-access-qbdxz\") pod \"service-ca-operator-5d46d9ffd4-mgkpz\" (UID: \"c17a2bef-e938-44e1-9227-049e597e25b7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:08.054308 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.054288 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k9xv\" (UniqueName: \"kubernetes.io/projected/cab84536-bacb-4d98-9113-c56f55190ef0-kube-api-access-8k9xv\") pod \"volume-data-source-validator-5d456fdbcd-8dxsz\" (UID: \"cab84536-bacb-4d98-9113-c56f55190ef0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz" Jul 06 22:28:08.117517 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.117487 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" Jul 06 22:28:08.135932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.135916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz" Jul 06 22:28:08.147455 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.147426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7672\" (UniqueName: \"kubernetes.io/projected/ba1f3831-e11d-477f-85d5-e0330cc02f05-kube-api-access-n7672\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.147598 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.147473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dff7a4cb-8915-4940-ba8a-5239effff1e4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.147598 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.147498 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dff7a4cb-8915-4940-ba8a-5239effff1e4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.147598 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.147529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r8kj\" (UniqueName: \"kubernetes.io/projected/99e76c88-587d-4adb-8b2d-045454871513-kube-api-access-2r8kj\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:08.148106 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.148045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1f3831-e11d-477f-85d5-e0330cc02f05-serving-cert\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.148121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxw7l\" (UniqueName: \"kubernetes.io/projected/dff7a4cb-8915-4940-ba8a-5239effff1e4-kube-api-access-vxw7l\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.148177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba1f3831-e11d-477f-85d5-e0330cc02f05-config\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.148298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.148325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba1f3831-e11d-477f-85d5-e0330cc02f05-trusted-ca\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.148491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dff7a4cb-8915-4940-ba8a-5239effff1e4-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.149446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ba1f3831-e11d-477f-85d5-e0330cc02f05-trusted-ca\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.149468 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba1f3831-e11d-477f-85d5-e0330cc02f05-config\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.149569 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:28:08.150145 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.149635 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls podName:99e76c88-587d-4adb-8b2d-045454871513 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:08.649616656 +0000 UTC m=+39.165256239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29v8x" (UID: "99e76c88-587d-4adb-8b2d-045454871513") : secret "samples-operator-tls" not found Jul 06 22:28:08.151167 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.150890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1f3831-e11d-477f-85d5-e0330cc02f05-serving-cert\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.151863 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.151836 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dff7a4cb-8915-4940-ba8a-5239effff1e4-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.155550 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.155526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7672\" (UniqueName: \"kubernetes.io/projected/ba1f3831-e11d-477f-85d5-e0330cc02f05-kube-api-access-n7672\") pod \"console-operator-68b757fb67-f225l\" (UID: \"ba1f3831-e11d-477f-85d5-e0330cc02f05\") " pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.155743 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.155703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r8kj\" (UniqueName: \"kubernetes.io/projected/99e76c88-587d-4adb-8b2d-045454871513-kube-api-access-2r8kj\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:08.160875 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.160849 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxw7l\" (UniqueName: \"kubernetes.io/projected/dff7a4cb-8915-4940-ba8a-5239effff1e4-kube-api-access-vxw7l\") pod \"kube-storage-version-migrator-operator-846bf668f7-8wzwv\" (UID: \"dff7a4cb-8915-4940-ba8a-5239effff1e4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.219450 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.219399 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" Jul 06 22:28:08.239187 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.238999 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sd79s"] Jul 06 22:28:08.242469 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:08.242414 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3293b7a8_e16f_45e1_9657_62b1bac7bd29.slice/crio-e407666293ac8f63517545a23d8b655002378cebfe533a186a80621a31581126 WatchSource:0}: Error finding container e407666293ac8f63517545a23d8b655002378cebfe533a186a80621a31581126: Status 404 returned error can't find the container with id e407666293ac8f63517545a23d8b655002378cebfe533a186a80621a31581126 Jul 06 22:28:08.249515 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.249483 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:08.269931 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.269096 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz"] Jul 06 22:28:08.274423 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.274392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sd79s" event={"ID":"3293b7a8-e16f-45e1-9657-62b1bac7bd29","Type":"ContainerStarted","Data":"e407666293ac8f63517545a23d8b655002378cebfe533a186a80621a31581126"} Jul 06 22:28:08.316735 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.316643 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz"] Jul 06 22:28:08.382842 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.382814 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv"] Jul 06 22:28:08.386490 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:08.386463 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab84536_bacb_4d98_9113_c56f55190ef0.slice/crio-a11e5f5453e78b8f22dabd611c6b9409d1bdd20e5d0a39920e3352152bdfb242 WatchSource:0}: Error finding container a11e5f5453e78b8f22dabd611c6b9409d1bdd20e5d0a39920e3352152bdfb242: Status 404 returned error can't find the container with id a11e5f5453e78b8f22dabd611c6b9409d1bdd20e5d0a39920e3352152bdfb242 Jul 06 22:28:08.387028 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:08.386997 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff7a4cb_8915_4940_ba8a_5239effff1e4.slice/crio-390165327bcd6987b95f4eab121d9e7f91e56085487a2faf3ec2e7ba70e3152c WatchSource:0}: Error finding container 390165327bcd6987b95f4eab121d9e7f91e56085487a2faf3ec2e7ba70e3152c: Status 404 returned error can't find the container with id 390165327bcd6987b95f4eab121d9e7f91e56085487a2faf3ec2e7ba70e3152c Jul 06 22:28:08.425704 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.425680 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-f225l"] Jul 06 22:28:08.428518 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:08.428497 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1f3831_e11d_477f_85d5_e0330cc02f05.slice/crio-4e5090103c75bd96ba5aae25e229c3dd74ad396704f28d56064e6e3f6b04b25f WatchSource:0}: Error finding container 4e5090103c75bd96ba5aae25e229c3dd74ad396704f28d56064e6e3f6b04b25f: Status 404 returned error can't find the container with id 4e5090103c75bd96ba5aae25e229c3dd74ad396704f28d56064e6e3f6b04b25f Jul 06 22:28:08.653915 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:08.653889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:08.654094 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.654074 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:28:08.654170 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:08.654159 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls podName:99e76c88-587d-4adb-8b2d-045454871513 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:09.654134471 +0000 UTC m=+40.169774070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29v8x" (UID: "99e76c88-587d-4adb-8b2d-045454871513") : secret "samples-operator-tls" not found Jul 06 22:28:09.286127 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:09.286083 2577 generic.go:356] "Generic (PLEG): container finished" podID="5027701b-787f-4cf2-a44e-6812631aadae" containerID="6e0ce343ee1ed4f15f4377248263b9264a08e18c8c97efeb2fac96ec4d7cb9dd" exitCode=0 Jul 06 22:28:09.286991 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:09.286391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerDied","Data":"6e0ce343ee1ed4f15f4377248263b9264a08e18c8c97efeb2fac96ec4d7cb9dd"} Jul 06 22:28:09.295432 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:09.295350 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" event={"ID":"c17a2bef-e938-44e1-9227-049e597e25b7","Type":"ContainerStarted","Data":"2cd54bd9a356fb1b5113139f05c6f5f889eb352ec51d5f5e26cd244f4418fd0d"} Jul 06 22:28:09.298388 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:09.298341 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-f225l" event={"ID":"ba1f3831-e11d-477f-85d5-e0330cc02f05","Type":"ContainerStarted","Data":"4e5090103c75bd96ba5aae25e229c3dd74ad396704f28d56064e6e3f6b04b25f"} Jul 06 22:28:09.301839 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:09.301747 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" event={"ID":"dff7a4cb-8915-4940-ba8a-5239effff1e4","Type":"ContainerStarted","Data":"390165327bcd6987b95f4eab121d9e7f91e56085487a2faf3ec2e7ba70e3152c"} Jul 06 22:28:09.304116 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:09.304060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz" event={"ID":"cab84536-bacb-4d98-9113-c56f55190ef0","Type":"ContainerStarted","Data":"a11e5f5453e78b8f22dabd611c6b9409d1bdd20e5d0a39920e3352152bdfb242"} Jul 06 22:28:09.662614 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:09.662044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:09.662614 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:09.662193 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:28:09.662614 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:09.662256 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls podName:99e76c88-587d-4adb-8b2d-045454871513 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:11.662237309 +0000 UTC m=+42.177876900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29v8x" (UID: "99e76c88-587d-4adb-8b2d-045454871513") : secret "samples-operator-tls" not found Jul 06 22:28:10.065970 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:10.065921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:10.066146 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:10.065996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:10.066212 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:10.066172 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:28:10.066212 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:10.066178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:10.066316 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:10.066247 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:14.066224855 +0000 UTC m=+44.581864454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : secret "insights-runtime-extractor-tls" not found Jul 06 22:28:10.066316 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:10.066277 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:28:10.066423 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:10.066340 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:14.066323761 +0000 UTC m=+44.581963358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : configmap "kube-rbac-proxy" not found Jul 06 22:28:10.066423 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:10.066414 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:28:10.066532 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:10.066448 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls podName:d2c61271-8422-4b25-b7c8-a128bd188946 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:14.066437072 +0000 UTC m=+44.582076672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls") pod "dns-default-x9f4s" (UID: "d2c61271-8422-4b25-b7c8-a128bd188946") : secret "dns-default-metrics-tls" not found Jul 06 22:28:10.310230 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:10.310198 2577 generic.go:356] "Generic (PLEG): container finished" podID="5027701b-787f-4cf2-a44e-6812631aadae" containerID="413aa658130f8046ccbbb184c485e9328057e4ac44ec6bfbd5ac1232cbffd666" exitCode=0 Jul 06 22:28:10.310663 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:10.310256 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerDied","Data":"413aa658130f8046ccbbb184c485e9328057e4ac44ec6bfbd5ac1232cbffd666"} Jul 06 22:28:10.649750 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:10.649706 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:10.709205 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:10.709171 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:11.676290 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:11.676257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:11.676618 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:11.676358 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:28:11.676618 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:11.676407 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls podName:99e76c88-587d-4adb-8b2d-045454871513 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:15.676394158 +0000 UTC m=+46.192033754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29v8x" (UID: "99e76c88-587d-4adb-8b2d-045454871513") : secret "samples-operator-tls" not found Jul 06 22:28:13.924596 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.924571 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7577f679b8-n6mmc"] Jul 06 22:28:13.939429 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.939405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:13.942662 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.942042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cjrqw\"" Jul 06 22:28:13.942662 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.942138 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7577f679b8-n6mmc"] Jul 06 22:28:13.942662 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.942274 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 22:28:13.942662 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.942275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 22:28:13.942662 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.942516 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 22:28:13.948538 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.948257 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 22:28:13.992576 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.992498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-image-registry-private-configuration\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:13.992739 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.992586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-certificates\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:13.992739 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.992615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b3b47-ab12-40b7-94b0-86b8df9044c1-ca-trust-extracted\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:13.992739 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.992637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq5rx\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-kube-api-access-nq5rx\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:13.992739 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.992693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:13.992739 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.992726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-installation-pull-secrets\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:13.993006 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.992762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-bound-sa-token\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:13.993006 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:13.992844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-trusted-ca\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.093895 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.093857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:14.094059 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.093902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-certificates\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094059 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.093923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b3b47-ab12-40b7-94b0-86b8df9044c1-ca-trust-extracted\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094059 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.093963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq5rx\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-kube-api-access-nq5rx\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094059 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:14.094059 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094033 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:28:14.094303 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094085 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 22:28:14.094303 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094107 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls podName:d2c61271-8422-4b25-b7c8-a128bd188946 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:22.094086005 +0000 UTC m=+52.609725601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls") pod "dns-default-x9f4s" (UID: "d2c61271-8422-4b25-b7c8-a128bd188946") : secret "dns-default-metrics-tls" not found Jul 06 22:28:14.094303 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094135 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:22.094117756 +0000 UTC m=+52.609757359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : configmap "kube-rbac-proxy" not found Jul 06 22:28:14.094303 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094303 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:14.094303 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-installation-pull-secrets\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094303 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-bound-sa-token\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094303 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-trusted-ca\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094732 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-image-registry-private-configuration\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094732 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094373 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:28:14.094732 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094385 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7577f679b8-n6mmc: secret "image-registry-tls" not found Jul 06 22:28:14.094732 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094342 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b3b47-ab12-40b7-94b0-86b8df9044c1-ca-trust-extracted\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094732 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094420 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls podName:326b3b47-ab12-40b7-94b0-86b8df9044c1 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:14.594408807 +0000 UTC m=+45.110048393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls") pod "image-registry-7577f679b8-n6mmc" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1") : secret "image-registry-tls" not found Jul 06 22:28:14.094732 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094489 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:28:14.094732 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.094534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-certificates\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.094732 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.094539 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:22.09452352 +0000 UTC m=+52.610163123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : secret "insights-runtime-extractor-tls" not found Jul 06 22:28:14.095234 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.095215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-trusted-ca\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.097802 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.097772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-image-registry-private-configuration\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.097802 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.097772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-installation-pull-secrets\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.103575 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.103551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-bound-sa-token\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.103758 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.103739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq5rx\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-kube-api-access-nq5rx\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.322499 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.322427 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/0.log" Jul 06 22:28:14.322499 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.322468 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba1f3831-e11d-477f-85d5-e0330cc02f05" containerID="c3a996f7a528c309330baffe118d5f6f103ff01896025536f883c3e93e69bfef" exitCode=255 Jul 06 22:28:14.322694 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.322545 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-f225l" event={"ID":"ba1f3831-e11d-477f-85d5-e0330cc02f05","Type":"ContainerDied","Data":"c3a996f7a528c309330baffe118d5f6f103ff01896025536f883c3e93e69bfef"} Jul 06 22:28:14.322809 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.322793 2577 scope.go:117] "RemoveContainer" containerID="c3a996f7a528c309330baffe118d5f6f103ff01896025536f883c3e93e69bfef" Jul 06 22:28:14.328084 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.328059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" event={"ID":"dff7a4cb-8915-4940-ba8a-5239effff1e4","Type":"ContainerStarted","Data":"dc3d394aa674d232d9c8a3a168650f19c3378241457820704c53bcdb3bb8c2d4"} Jul 06 22:28:14.333744 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.329701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz" event={"ID":"cab84536-bacb-4d98-9113-c56f55190ef0","Type":"ContainerStarted","Data":"6005d3cf4080d05f0fdde2459fe37326590441557c622d9b037147c1dba3bdae"} Jul 06 22:28:14.337375 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.337350 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" event={"ID":"5027701b-787f-4cf2-a44e-6812631aadae","Type":"ContainerStarted","Data":"072971f6b3fe9c98b88a3e02a41d4facd885b30256947645bbcddfa5879117b4"} Jul 06 22:28:14.339585 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.339494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" event={"ID":"c17a2bef-e938-44e1-9227-049e597e25b7","Type":"ContainerStarted","Data":"a514488f5a8ec03e65a1c3eb17e2c530a52f92d8028f5738ae79406509365623"} Jul 06 22:28:14.340868 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.340846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sd79s" event={"ID":"3293b7a8-e16f-45e1-9657-62b1bac7bd29","Type":"ContainerStarted","Data":"9c919a5c2f1978af59be1d219ae8bede2dbb245f2e7caf40b1fdad842a26373a"} Jul 06 22:28:14.352024 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.351987 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-8dxsz" podStartSLOduration=2.066254167 podStartE2EDuration="7.351973537s" totalImagesPullingTime="5.28571937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:14.351287352 +0000 UTC m=+44.866926957" watchObservedRunningTime="2026-07-06 22:28:14.351973537 +0000 UTC m=+44.867613138" Jul 06 22:28:14.373001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.372935 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dj4jg" podStartSLOduration=10.411824954 podStartE2EDuration="43.372920748s" totalImagesPullingTime="32.961095794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:14.37259312 +0000 UTC m=+44.888232725" watchObservedRunningTime="2026-07-06 22:28:14.372920748 +0000 UTC m=+44.888560353" Jul 06 22:28:14.405779 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.405739 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" podStartSLOduration=2.063960452 podStartE2EDuration="7.405725738s" totalImagesPullingTime="5.341765286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:14.404470292 +0000 UTC m=+44.920109897" watchObservedRunningTime="2026-07-06 22:28:14.405725738 +0000 UTC m=+44.921365342" Jul 06 22:28:14.432387 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.432339 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sd79s" podStartSLOduration=2.940249582 podStartE2EDuration="8.432319981s" totalImagesPullingTime="5.492070399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:14.430700561 +0000 UTC m=+44.946340176" watchObservedRunningTime="2026-07-06 22:28:14.432319981 +0000 UTC m=+44.947959586" Jul 06 22:28:14.457215 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.457162 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" podStartSLOduration=1.998842098 podStartE2EDuration="7.457141761s" totalImagesPullingTime="5.458299663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:14.457046231 +0000 UTC m=+44.972685826" watchObservedRunningTime="2026-07-06 22:28:14.457141761 +0000 UTC m=+44.972781366" Jul 06 22:28:14.544251 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.544224 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:14.598552 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.598481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:14.598656 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.598628 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:28:14.598707 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.598659 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7577f679b8-n6mmc: secret "image-registry-tls" not found Jul 06 22:28:14.598753 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:14.598717 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls podName:326b3b47-ab12-40b7-94b0-86b8df9044c1 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:15.598702825 +0000 UTC m=+46.114342434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls") pod "image-registry-7577f679b8-n6mmc" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1") : secret "image-registry-tls" not found Jul 06 22:28:14.599502 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:14.599474 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.265990 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.265930 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.345464 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.345442 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/1.log" Jul 06 22:28:15.345941 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.345923 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/0.log" Jul 06 22:28:15.346064 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.345978 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba1f3831-e11d-477f-85d5-e0330cc02f05" containerID="32237ef7f9d993358f14ce4f112b40967ad362098331cf922bae6a2263d486c4" exitCode=255 Jul 06 22:28:15.346124 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.346092 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-f225l" event={"ID":"ba1f3831-e11d-477f-85d5-e0330cc02f05","Type":"ContainerDied","Data":"32237ef7f9d993358f14ce4f112b40967ad362098331cf922bae6a2263d486c4"} Jul 06 22:28:15.346355 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.346161 2577 scope.go:117] "RemoveContainer" containerID="c3a996f7a528c309330baffe118d5f6f103ff01896025536f883c3e93e69bfef" Jul 06 22:28:15.346439 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.346364 2577 scope.go:117] "RemoveContainer" containerID="32237ef7f9d993358f14ce4f112b40967ad362098331cf922bae6a2263d486c4" Jul 06 22:28:15.346616 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:15.346589 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-f225l_openshift-console-operator(ba1f3831-e11d-477f-85d5-e0330cc02f05)\"" pod="openshift-console-operator/console-operator-68b757fb67-f225l" podUID="ba1f3831-e11d-477f-85d5-e0330cc02f05" Jul 06 22:28:15.458920 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.458884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.481743 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.481715 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4"] Jul 06 22:28:15.502041 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.502019 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4"] Jul 06 22:28:15.502150 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.502104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" Jul 06 22:28:15.505188 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.505156 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 22:28:15.505318 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.505210 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6pvgw\"" Jul 06 22:28:15.505318 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.505231 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 22:28:15.552909 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.552851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.607194 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.607167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:15.607355 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.607201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw5lh\" (UniqueName: \"kubernetes.io/projected/a65aef45-e15e-477f-a261-53557944b317-kube-api-access-lw5lh\") pod \"migrator-d57d58cc9-mtgl4\" (UID: \"a65aef45-e15e-477f-a261-53557944b317\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" Jul 06 22:28:15.607355 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:15.607327 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:28:15.607355 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:15.607344 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7577f679b8-n6mmc: secret "image-registry-tls" not found Jul 06 22:28:15.607447 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:15.607394 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls podName:326b3b47-ab12-40b7-94b0-86b8df9044c1 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:17.607379688 +0000 UTC m=+48.123019286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls") pod "image-registry-7577f679b8-n6mmc" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1") : secret "image-registry-tls" not found Jul 06 22:28:15.651689 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.651661 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.707908 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.707875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw5lh\" (UniqueName: \"kubernetes.io/projected/a65aef45-e15e-477f-a261-53557944b317-kube-api-access-lw5lh\") pod \"migrator-d57d58cc9-mtgl4\" (UID: \"a65aef45-e15e-477f-a261-53557944b317\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" Jul 06 22:28:15.708078 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.707926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:15.708078 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:15.708072 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:28:15.708181 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:15.708125 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls podName:99e76c88-587d-4adb-8b2d-045454871513 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:23.708107943 +0000 UTC m=+54.223747538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29v8x" (UID: "99e76c88-587d-4adb-8b2d-045454871513") : secret "samples-operator-tls" not found Jul 06 22:28:15.718733 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.718707 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw5lh\" (UniqueName: \"kubernetes.io/projected/a65aef45-e15e-477f-a261-53557944b317-kube-api-access-lw5lh\") pod \"migrator-d57d58cc9-mtgl4\" (UID: \"a65aef45-e15e-477f-a261-53557944b317\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" Jul 06 22:28:15.751568 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.751541 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.809856 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.809793 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:15.812023 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.811995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" Jul 06 22:28:15.957088 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.957036 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4"] Jul 06 22:28:15.959635 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:15.959606 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda65aef45_e15e_477f_a261_53557944b317.slice/crio-9a41d380947e61b7c8bbca6b7711b8e875ce38e968930671efd110a2151560e3 WatchSource:0}: Error finding container 9a41d380947e61b7c8bbca6b7711b8e875ce38e968930671efd110a2151560e3: Status 404 returned error can't find the container with id 9a41d380947e61b7c8bbca6b7711b8e875ce38e968930671efd110a2151560e3 Jul 06 22:28:15.974351 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:15.974326 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:16.075918 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:16.075841 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:16.349652 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:16.349579 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/1.log" Jul 06 22:28:16.350076 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:16.349907 2577 scope.go:117] "RemoveContainer" containerID="32237ef7f9d993358f14ce4f112b40967ad362098331cf922bae6a2263d486c4" Jul 06 22:28:16.350144 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:16.350100 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-f225l_openshift-console-operator(ba1f3831-e11d-477f-85d5-e0330cc02f05)\"" pod="openshift-console-operator/console-operator-68b757fb67-f225l" podUID="ba1f3831-e11d-477f-85d5-e0330cc02f05" Jul 06 22:28:16.350766 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:16.350743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" event={"ID":"a65aef45-e15e-477f-a261-53557944b317","Type":"ContainerStarted","Data":"9a41d380947e61b7c8bbca6b7711b8e875ce38e968930671efd110a2151560e3"} Jul 06 22:28:16.443546 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:16.443519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:16.543918 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:16.543890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:17.524030 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.523997 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl"] Jul 06 22:28:17.541038 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.541014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl"] Jul 06 22:28:17.541170 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.541110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl" Jul 06 22:28:17.543332 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.543305 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-772ns\"" Jul 06 22:28:17.624344 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.624311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svkvl\" (UniqueName: \"kubernetes.io/projected/e411a6c2-14a4-42a2-a5bd-13a4fecbe18c-kube-api-access-svkvl\") pod \"network-check-source-989f8b8dc-2hvdl\" (UID: \"e411a6c2-14a4-42a2-a5bd-13a4fecbe18c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl" Jul 06 22:28:17.624344 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.624355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:17.624540 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:17.624488 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:28:17.624540 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:17.624507 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7577f679b8-n6mmc: secret "image-registry-tls" not found Jul 06 22:28:17.624604 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:17.624557 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls podName:326b3b47-ab12-40b7-94b0-86b8df9044c1 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:21.624540045 +0000 UTC m=+52.140179646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls") pod "image-registry-7577f679b8-n6mmc" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1") : secret "image-registry-tls" not found Jul 06 22:28:17.724967 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.724920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svkvl\" (UniqueName: \"kubernetes.io/projected/e411a6c2-14a4-42a2-a5bd-13a4fecbe18c-kube-api-access-svkvl\") pod \"network-check-source-989f8b8dc-2hvdl\" (UID: \"e411a6c2-14a4-42a2-a5bd-13a4fecbe18c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl" Jul 06 22:28:17.733368 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.733339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svkvl\" (UniqueName: \"kubernetes.io/projected/e411a6c2-14a4-42a2-a5bd-13a4fecbe18c-kube-api-access-svkvl\") pod \"network-check-source-989f8b8dc-2hvdl\" (UID: \"e411a6c2-14a4-42a2-a5bd-13a4fecbe18c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl" Jul 06 22:28:17.850176 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.850154 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl" Jul 06 22:28:17.995365 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:17.995330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl"] Jul 06 22:28:17.998882 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:17.998855 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode411a6c2_14a4_42a2_a5bd_13a4fecbe18c.slice/crio-c30520372deb29ab4b0f149d91855d719b78aba0b3191683f77d09db54dec3af WatchSource:0}: Error finding container c30520372deb29ab4b0f149d91855d719b78aba0b3191683f77d09db54dec3af: Status 404 returned error can't find the container with id c30520372deb29ab4b0f149d91855d719b78aba0b3191683f77d09db54dec3af Jul 06 22:28:18.083086 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.083022 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:18.250408 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.250383 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:18.250519 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.250429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:18.250738 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.250719 2577 scope.go:117] "RemoveContainer" containerID="32237ef7f9d993358f14ce4f112b40967ad362098331cf922bae6a2263d486c4" Jul 06 22:28:18.250880 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:18.250862 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-f225l_openshift-console-operator(ba1f3831-e11d-477f-85d5-e0330cc02f05)\"" pod="openshift-console-operator/console-operator-68b757fb67-f225l" podUID="ba1f3831-e11d-477f-85d5-e0330cc02f05" Jul 06 22:28:18.357822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.357757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" event={"ID":"a65aef45-e15e-477f-a261-53557944b317","Type":"ContainerStarted","Data":"257bbd7623c74a653671e2ee26292b8ee7306c129165950b6a9d60128ed671f3"} Jul 06 22:28:18.357822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.357819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" event={"ID":"a65aef45-e15e-477f-a261-53557944b317","Type":"ContainerStarted","Data":"846742ca58700583653d9e719dc1c7105184a7b72a659b2a9e651e7f31cad71c"} Jul 06 22:28:18.358999 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.358938 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl" event={"ID":"e411a6c2-14a4-42a2-a5bd-13a4fecbe18c","Type":"ContainerStarted","Data":"c30520372deb29ab4b0f149d91855d719b78aba0b3191683f77d09db54dec3af"} Jul 06 22:28:18.377171 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.377130 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-mtgl4" podStartSLOduration=1.529838292 podStartE2EDuration="3.37711699s" totalImagesPullingTime="1.847278698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:18.375673027 +0000 UTC m=+48.891312630" watchObservedRunningTime="2026-07-06 22:28:18.37711699 +0000 UTC m=+48.892756594" Jul 06 22:28:18.452555 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.452526 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:18.554444 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.554343 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:18.951933 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:18.951897 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:21.657763 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:21.657731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:21.658143 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:21.657880 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 22:28:21.658143 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:21.657899 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7577f679b8-n6mmc: secret "image-registry-tls" not found Jul 06 22:28:21.658143 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:21.657967 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls podName:326b3b47-ab12-40b7-94b0-86b8df9044c1 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:29.657938135 +0000 UTC m=+60.173577731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls") pod "image-registry-7577f679b8-n6mmc" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1") : secret "image-registry-tls" not found Jul 06 22:28:21.909478 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:21.909404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:22.008213 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.008184 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:22.162527 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.162456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:22.162688 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.162530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:22.162688 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.162579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:22.162688 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:22.162607 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 22:28:22.162688 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:22.162671 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls podName:d2c61271-8422-4b25-b7c8-a128bd188946 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:38.162652899 +0000 UTC m=+68.678292496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls") pod "dns-default-x9f4s" (UID: "d2c61271-8422-4b25-b7c8-a128bd188946") : secret "dns-default-metrics-tls" not found Jul 06 22:28:22.162976 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:22.162690 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 22:28:22.162976 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:22.162754 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls podName:ca36c93c-ba5a-44da-b1bd-326edff908da nodeName:}" failed. No retries permitted until 2026-07-06 22:28:38.16273935 +0000 UTC m=+68.678378936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pv4fl" (UID: "ca36c93c-ba5a-44da-b1bd-326edff908da") : secret "insights-runtime-extractor-tls" not found Jul 06 22:28:22.163094 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.163009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca36c93c-ba5a-44da-b1bd-326edff908da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:22.223850 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.223821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:22.307295 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.307270 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:22.374758 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.374728 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl" event={"ID":"e411a6c2-14a4-42a2-a5bd-13a4fecbe18c","Type":"ContainerStarted","Data":"4cedbae39e0d81144f30b082da1ab7a1d5abda010e6dac84acfb3e4cf7870a0c"} Jul 06 22:28:22.399372 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.399327 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-2hvdl" podStartSLOduration=2.109726009 podStartE2EDuration="5.399312391s" totalImagesPullingTime="3.289586382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:22.398123599 +0000 UTC m=+52.913763205" watchObservedRunningTime="2026-07-06 22:28:22.399312391 +0000 UTC m=+52.914951995" Jul 06 22:28:22.403150 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.403119 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:22.614020 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.613905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:22.717827 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.717794 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:22.818974 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:22.818902 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:23.411460 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:23.411433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:23.774421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:23.774347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:23.774774 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:23.774484 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 22:28:23.774774 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:23.774538 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls podName:99e76c88-587d-4adb-8b2d-045454871513 nodeName:}" failed. No retries permitted until 2026-07-06 22:28:39.774524031 +0000 UTC m=+70.290163614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-29v8x" (UID: "99e76c88-587d-4adb-8b2d-045454871513") : secret "samples-operator-tls" not found Jul 06 22:28:24.013139 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:24.013106 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:24.213167 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:24.213137 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:24.410563 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:24.410534 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:24.813191 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:24.813160 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:25.365819 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:25.365790 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:25.594682 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:25.594627 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:25.696148 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:25.696121 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:25.812108 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:25.812070 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:26.217143 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:26.217117 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:26.420810 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:26.420781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:26.479361 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:26.479289 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:26.807520 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:26.807435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:27.430824 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:27.430792 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:28.042567 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:28.042527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:28.148257 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:28.148230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:28.251116 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:28.251086 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:28.446701 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:28.446676 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:28.637556 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:28.637512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:29.634834 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:29.634801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:29.718887 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:29.718861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:29.721129 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:29.721111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"image-registry-7577f679b8-n6mmc\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:29.856862 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:29.856804 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cjrqw\"" Jul 06 22:28:29.863316 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:29.863302 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:29.988065 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:29.988040 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7577f679b8-n6mmc"] Jul 06 22:28:29.990460 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:29.990439 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326b3b47_ab12_40b7_94b0_86b8df9044c1.slice/crio-ee6a2f1e65b4cb70195acd52e526a458397aa30f0921b575fb9b40879a7375f2 WatchSource:0}: Error finding container ee6a2f1e65b4cb70195acd52e526a458397aa30f0921b575fb9b40879a7375f2: Status 404 returned error can't find the container with id ee6a2f1e65b4cb70195acd52e526a458397aa30f0921b575fb9b40879a7375f2 Jul 06 22:28:30.013046 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.013021 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:30.015118 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.015103 2577 scope.go:117] "RemoveContainer" containerID="32237ef7f9d993358f14ce4f112b40967ad362098331cf922bae6a2263d486c4" Jul 06 22:28:30.222371 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.222335 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:30.400721 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.400694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:28:30.401164 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.401145 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/1.log" Jul 06 22:28:30.401262 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.401178 2577 generic.go:356] "Generic (PLEG): container finished" podID="ba1f3831-e11d-477f-85d5-e0330cc02f05" containerID="e2f551c773962a7b5a4abb5edbda1756685c5a283101829a3adaa7ab149715ab" exitCode=255 Jul 06 22:28:30.401311 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.401253 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-f225l" event={"ID":"ba1f3831-e11d-477f-85d5-e0330cc02f05","Type":"ContainerDied","Data":"e2f551c773962a7b5a4abb5edbda1756685c5a283101829a3adaa7ab149715ab"} Jul 06 22:28:30.401353 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.401323 2577 scope.go:117] "RemoveContainer" containerID="32237ef7f9d993358f14ce4f112b40967ad362098331cf922bae6a2263d486c4" Jul 06 22:28:30.401644 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.401624 2577 scope.go:117] "RemoveContainer" containerID="e2f551c773962a7b5a4abb5edbda1756685c5a283101829a3adaa7ab149715ab" Jul 06 22:28:30.401844 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:30.401821 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-f225l_openshift-console-operator(ba1f3831-e11d-477f-85d5-e0330cc02f05)\"" pod="openshift-console-operator/console-operator-68b757fb67-f225l" podUID="ba1f3831-e11d-477f-85d5-e0330cc02f05" Jul 06 22:28:30.402840 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.402821 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" event={"ID":"326b3b47-ab12-40b7-94b0-86b8df9044c1","Type":"ContainerStarted","Data":"f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa"} Jul 06 22:28:30.402944 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.402860 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" event={"ID":"326b3b47-ab12-40b7-94b0-86b8df9044c1","Type":"ContainerStarted","Data":"ee6a2f1e65b4cb70195acd52e526a458397aa30f0921b575fb9b40879a7375f2"} Jul 06 22:28:30.403034 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.403017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:28:30.411711 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.411646 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:30.438525 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.438478 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" podStartSLOduration=17.438463495 podStartE2EDuration="17.438463495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:30.437587059 +0000 UTC m=+60.953226664" watchObservedRunningTime="2026-07-06 22:28:30.438463495 +0000 UTC m=+60.954103122" Jul 06 22:28:30.674346 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:30.674314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:31.250143 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:31.250111 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:31.258315 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:31.258294 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cs28t" Jul 06 22:28:31.407385 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:31.407360 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:28:31.626225 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:31.626149 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:31.819663 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:31.819623 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:32.217275 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:32.217236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:32.315842 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:32.315816 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:32.415923 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:32.415871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:32.476391 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:32.476311 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:32.629814 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:32.629778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:33.023924 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:33.023886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:35.664818 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.664772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:28:35.667441 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.667424 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 22:28:35.677233 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.677208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b175a52e-2c98-4890-a694-c9e95cbc6c1b-metrics-certs\") pod \"network-metrics-daemon-5zvtm\" (UID: \"b175a52e-2c98-4890-a694-c9e95cbc6c1b\") " pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:28:35.765737 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.765698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:28:35.768433 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.768418 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 22:28:35.778169 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.778149 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9fede43d-c065-4ba5-8d6e-6c504e6754aa-original-pull-secret\") pod \"global-pull-secret-syncer-9p5mm\" (UID: \"9fede43d-c065-4ba5-8d6e-6c504e6754aa\") " pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:28:35.866251 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.866224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:35.868358 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.868330 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k5xb\" (UniqueName: \"kubernetes.io/projected/15a56041-14d0-4edc-854e-8efabfc3804b-kube-api-access-7k5xb\") pod \"network-check-target-bxv7s\" (UID: \"15a56041-14d0-4edc-854e-8efabfc3804b\") " pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:35.925993 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.925935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9p5mm" Jul 06 22:28:35.934237 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.934218 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kgqgb\"" Jul 06 22:28:35.938361 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.938343 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-69kbf\"" Jul 06 22:28:35.942386 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.942367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5zvtm" Jul 06 22:28:35.947292 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:35.947273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:36.074019 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.073853 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9p5mm"] Jul 06 22:28:36.076371 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:36.076348 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fede43d_c065_4ba5_8d6e_6c504e6754aa.slice/crio-cfea8f795f6e6abc4e1e759368cacba7890bafee24afb2bc97800ede82be9183 WatchSource:0}: Error finding container cfea8f795f6e6abc4e1e759368cacba7890bafee24afb2bc97800ede82be9183: Status 404 returned error can't find the container with id cfea8f795f6e6abc4e1e759368cacba7890bafee24afb2bc97800ede82be9183 Jul 06 22:28:36.289683 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.289616 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bxv7s"] Jul 06 22:28:36.292436 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.292414 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5zvtm"] Jul 06 22:28:36.292821 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:36.292798 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a56041_14d0_4edc_854e_8efabfc3804b.slice/crio-ab5874ebe522f8cdffde10194665d8b3a3557134ced6033ba9b27dc045200ac6 WatchSource:0}: Error finding container ab5874ebe522f8cdffde10194665d8b3a3557134ced6033ba9b27dc045200ac6: Status 404 returned error can't find the container with id ab5874ebe522f8cdffde10194665d8b3a3557134ced6033ba9b27dc045200ac6 Jul 06 22:28:36.295517 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:36.295500 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb175a52e_2c98_4890_a694_c9e95cbc6c1b.slice/crio-bf9731d110bcf80f1d5db18996e9c3817167bd6000c2d4b51634ccd7c5191c4e WatchSource:0}: Error finding container bf9731d110bcf80f1d5db18996e9c3817167bd6000c2d4b51634ccd7c5191c4e: Status 404 returned error can't find the container with id bf9731d110bcf80f1d5db18996e9c3817167bd6000c2d4b51634ccd7c5191c4e Jul 06 22:28:36.424798 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.424761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9p5mm" event={"ID":"9fede43d-c065-4ba5-8d6e-6c504e6754aa","Type":"ContainerStarted","Data":"cfea8f795f6e6abc4e1e759368cacba7890bafee24afb2bc97800ede82be9183"} Jul 06 22:28:36.425982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.425940 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5zvtm" event={"ID":"b175a52e-2c98-4890-a694-c9e95cbc6c1b","Type":"ContainerStarted","Data":"bf9731d110bcf80f1d5db18996e9c3817167bd6000c2d4b51634ccd7c5191c4e"} Jul 06 22:28:36.427277 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.427257 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bxv7s" event={"ID":"15a56041-14d0-4edc-854e-8efabfc3804b","Type":"ContainerStarted","Data":"e18a0911df622679b10d6d484d5d08bab901e55bc2fe13995a69db38cf7995b0"} Jul 06 22:28:36.427373 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.427290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bxv7s" event={"ID":"15a56041-14d0-4edc-854e-8efabfc3804b","Type":"ContainerStarted","Data":"ab5874ebe522f8cdffde10194665d8b3a3557134ced6033ba9b27dc045200ac6"} Jul 06 22:28:36.427437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.427396 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:28:36.444183 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:36.444144 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bxv7s" podStartSLOduration=64.44413239 podStartE2EDuration="1m4.44413239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:36.443074708 +0000 UTC m=+66.958714326" watchObservedRunningTime="2026-07-06 22:28:36.44413239 +0000 UTC m=+66.959772014" Jul 06 22:28:37.610788 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:37.610754 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:37.666062 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:37.666032 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:38.187289 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.187256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:38.187478 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.187322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:38.189942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.189916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2c61271-8422-4b25-b7c8-a128bd188946-metrics-tls\") pod \"dns-default-x9f4s\" (UID: \"d2c61271-8422-4b25-b7c8-a128bd188946\") " pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:38.189942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.189929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca36c93c-ba5a-44da-b1bd-326edff908da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pv4fl\" (UID: \"ca36c93c-ba5a-44da-b1bd-326edff908da\") " pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:38.250499 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.250471 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:38.250639 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.250530 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:38.250984 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.250945 2577 scope.go:117] "RemoveContainer" containerID="e2f551c773962a7b5a4abb5edbda1756685c5a283101829a3adaa7ab149715ab" Jul 06 22:28:38.251204 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:28:38.251174 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-f225l_openshift-console-operator(ba1f3831-e11d-477f-85d5-e0330cc02f05)\"" pod="openshift-console-operator/console-operator-68b757fb67-f225l" podUID="ba1f3831-e11d-477f-85d5-e0330cc02f05" Jul 06 22:28:38.366037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.366011 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z9fkj\"" Jul 06 22:28:38.374225 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.374204 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:38.392041 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.392020 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mcxxp\"" Jul 06 22:28:38.400029 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.400009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pv4fl" Jul 06 22:28:38.438942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.438862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5zvtm" event={"ID":"b175a52e-2c98-4890-a694-c9e95cbc6c1b","Type":"ContainerStarted","Data":"6e2d7a41761062a290d0b7d7dc040ca0debf29e219fb07c13290e02b3e449d9a"} Jul 06 22:28:38.438942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.438928 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5zvtm" event={"ID":"b175a52e-2c98-4890-a694-c9e95cbc6c1b","Type":"ContainerStarted","Data":"49ee005725911074561175468f98a2e7884152da956bb7e1e337077f8388ab72"} Jul 06 22:28:38.455658 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.455614 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5zvtm" podStartSLOduration=65.369116733 podStartE2EDuration="1m6.455597767s" totalImagesPullingTime="1.086481034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:38.455175949 +0000 UTC m=+68.970815564" watchObservedRunningTime="2026-07-06 22:28:38.455597767 +0000 UTC m=+68.971237370" Jul 06 22:28:38.528095 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.528062 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9f4s"] Jul 06 22:28:38.532368 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:38.532338 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c61271_8422_4b25_b7c8_a128bd188946.slice/crio-923df6c121092829fb18ab22f00485dd8113a159ea54b8674bb77111ea6ed498 WatchSource:0}: Error finding container 923df6c121092829fb18ab22f00485dd8113a159ea54b8674bb77111ea6ed498: Status 404 returned error can't find the container with id 923df6c121092829fb18ab22f00485dd8113a159ea54b8674bb77111ea6ed498 Jul 06 22:28:38.550537 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:38.550428 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pv4fl"] Jul 06 22:28:38.552773 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:38.552752 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca36c93c_ba5a_44da_b1bd_326edff908da.slice/crio-bee92d44157c498d6c5d14e7cd688440d24573e77dc091257c174f9cdf3d46ae WatchSource:0}: Error finding container bee92d44157c498d6c5d14e7cd688440d24573e77dc091257c174f9cdf3d46ae: Status 404 returned error can't find the container with id bee92d44157c498d6c5d14e7cd688440d24573e77dc091257c174f9cdf3d46ae Jul 06 22:28:39.084785 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.084755 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7"] Jul 06 22:28:39.110526 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.110499 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7"] Jul 06 22:28:39.110690 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.110619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.115031 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.115000 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 22:28:39.115673 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.115651 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 22:28:39.116188 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.116166 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 22:28:39.116484 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.116462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 22:28:39.116593 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.116505 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 22:28:39.116761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.116727 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 22:28:39.116842 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.116747 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 22:28:39.125089 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.125067 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7577f679b8-n6mmc"] Jul 06 22:28:39.162408 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.162385 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8655b7bfd9-5gg5b"] Jul 06 22:28:39.181130 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.180493 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8655b7bfd9-5gg5b"] Jul 06 22:28:39.181130 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.180602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.196996 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.196971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgjc4\" (UniqueName: \"kubernetes.io/projected/fcc975bb-6d05-406a-aaa2-4b279f9ff297-kube-api-access-wgjc4\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.197104 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.197006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.197104 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.197063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-hub\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.197104 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.197092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcc975bb-6d05-406a-aaa2-4b279f9ff297-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.197237 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.197126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-ca\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.197237 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.197188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.258638 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.258568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:39.298011 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.297980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-image-registry-private-configuration\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.298161 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.298161 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-registry-tls\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.298161 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6bh2\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-kube-api-access-p6bh2\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.298335 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-ca-trust-extracted\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.298335 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgjc4\" (UniqueName: \"kubernetes.io/projected/fcc975bb-6d05-406a-aaa2-4b279f9ff297-kube-api-access-wgjc4\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.298335 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-registry-certificates\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.298335 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.298335 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-installation-pull-secrets\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.298589 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-bound-sa-token\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.298589 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-hub\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.298589 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcc975bb-6d05-406a-aaa2-4b279f9ff297-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.298589 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-ca\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.298589 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.298575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-trusted-ca\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.299306 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.299256 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcc975bb-6d05-406a-aaa2-4b279f9ff297-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.301465 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.301431 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.301583 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.301487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-hub\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.301656 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.301631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-ca\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.302028 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.302009 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fcc975bb-6d05-406a-aaa2-4b279f9ff297-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.315235 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.315213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgjc4\" (UniqueName: \"kubernetes.io/projected/fcc975bb-6d05-406a-aaa2-4b279f9ff297-kube-api-access-wgjc4\") pod \"cluster-proxy-proxy-agent-5c7446958c-snmd7\" (UID: \"fcc975bb-6d05-406a-aaa2-4b279f9ff297\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.391864 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.391785 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:39.399797 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.399758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-trusted-ca\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.399809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-image-registry-private-configuration\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.399867 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-registry-tls\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.399892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6bh2\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-kube-api-access-p6bh2\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.399928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-ca-trust-extracted\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.399981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-registry-certificates\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400343 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.400010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-installation-pull-secrets\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400343 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.400039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-bound-sa-token\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400744 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.400719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-trusted-ca\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.400923 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.400902 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-registry-certificates\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.401019 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.401000 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-ca-trust-extracted\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.403573 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.403490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-image-registry-private-configuration\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.403573 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.403529 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-registry-tls\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.403694 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.403566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-installation-pull-secrets\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.410709 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.410690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6bh2\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-kube-api-access-p6bh2\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.411070 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.411046 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6-bound-sa-token\") pod \"image-registry-8655b7bfd9-5gg5b\" (UID: \"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6\") " pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.431134 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.431111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" Jul 06 22:28:39.446194 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.446167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9f4s" event={"ID":"d2c61271-8422-4b25-b7c8-a128bd188946","Type":"ContainerStarted","Data":"923df6c121092829fb18ab22f00485dd8113a159ea54b8674bb77111ea6ed498"} Jul 06 22:28:39.447543 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.447520 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pv4fl" event={"ID":"ca36c93c-ba5a-44da-b1bd-326edff908da","Type":"ContainerStarted","Data":"bee92d44157c498d6c5d14e7cd688440d24573e77dc091257c174f9cdf3d46ae"} Jul 06 22:28:39.469634 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.469595 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:39.503181 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.503156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:39.569887 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.569789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:39.804795 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.804753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:39.807352 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:39.807330 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/99e76c88-587d-4adb-8b2d-045454871513-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-29v8x\" (UID: \"99e76c88-587d-4adb-8b2d-045454871513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:40.032152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.032117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l6qdm\"" Jul 06 22:28:40.040516 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.040492 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" Jul 06 22:28:40.127328 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.127285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:40.197853 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.197823 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8655b7bfd9-5gg5b"] Jul 06 22:28:40.201308 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:40.201159 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6d9a6f_9a7c_4e9f_98a7_2fd7df8b0dd6.slice/crio-205201fd9abeac1941d9c44e15d4d2641f44931a82afe257b6ce7f0b8971daa4 WatchSource:0}: Error finding container 205201fd9abeac1941d9c44e15d4d2641f44931a82afe257b6ce7f0b8971daa4: Status 404 returned error can't find the container with id 205201fd9abeac1941d9c44e15d4d2641f44931a82afe257b6ce7f0b8971daa4 Jul 06 22:28:40.216344 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.216242 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7"] Jul 06 22:28:40.230134 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.230112 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x"] Jul 06 22:28:40.347721 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:40.347660 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcc975bb_6d05_406a_aaa2_4b279f9ff297.slice/crio-2fa728ee2a1be4ceb630bf690f6c70e0e650bdebd1b6253984e688195a05c57f WatchSource:0}: Error finding container 2fa728ee2a1be4ceb630bf690f6c70e0e650bdebd1b6253984e688195a05c57f: Status 404 returned error can't find the container with id 2fa728ee2a1be4ceb630bf690f6c70e0e650bdebd1b6253984e688195a05c57f Jul 06 22:28:40.454895 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.454860 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" event={"ID":"fcc975bb-6d05-406a-aaa2-4b279f9ff297","Type":"ContainerStarted","Data":"2fa728ee2a1be4ceb630bf690f6c70e0e650bdebd1b6253984e688195a05c57f"} Jul 06 22:28:40.458781 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.458752 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" event={"ID":"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6","Type":"ContainerStarted","Data":"205201fd9abeac1941d9c44e15d4d2641f44931a82afe257b6ce7f0b8971daa4"} Jul 06 22:28:40.460998 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.460917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" event={"ID":"99e76c88-587d-4adb-8b2d-045454871513","Type":"ContainerStarted","Data":"6f02360731a158b69726efe27ba48e1fbd78da0791110f45568266836d9e90d9"} Jul 06 22:28:40.519418 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.519251 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:40.622516 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:40.622389 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:41.468398 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:41.468284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" event={"ID":"ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6","Type":"ContainerStarted","Data":"549aca895ca37390a016d908306c1728754d24dbd9acd2a0734753dd9b5d12ff"} Jul 06 22:28:41.468946 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:41.468876 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:28:41.470976 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:41.470716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9p5mm" event={"ID":"9fede43d-c065-4ba5-8d6e-6c504e6754aa","Type":"ContainerStarted","Data":"1773c76e09614e44d0f335e86a2e7db0e2d9c24404385b2bbe59f39101f79f07"} Jul 06 22:28:41.489381 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:41.489331 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" podStartSLOduration=2.489313059 podStartE2EDuration="2.489313059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:41.486844563 +0000 UTC m=+72.002484163" watchObservedRunningTime="2026-07-06 22:28:41.489313059 +0000 UTC m=+72.004952657" Jul 06 22:28:43.250104 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:43.250015 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:43.351103 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:43.351026 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:43.412557 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:43.412483 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:44.424653 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:44.424614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:44.512936 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:44.512903 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:44.718174 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:44.718079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:47.240572 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:47.240526 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:47.382333 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:47.382300 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:47.439463 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:47.439433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:47.493078 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:47.492942 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:48.500261 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.500227 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pv4fl" event={"ID":"ca36c93c-ba5a-44da-b1bd-326edff908da","Type":"ContainerStarted","Data":"dfd57c04c9b991f8597dbd2b14da60a4f0e913352922dc9ee142a7f293f6ed74"} Jul 06 22:28:48.500641 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.500292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pv4fl" event={"ID":"ca36c93c-ba5a-44da-b1bd-326edff908da","Type":"ContainerStarted","Data":"8cc7e0e849e8d751fc0aa4f51c41b24476f9f66afb3171b8d0a88e17955d68a5"} Jul 06 22:28:48.501880 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.501850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9f4s" event={"ID":"d2c61271-8422-4b25-b7c8-a128bd188946","Type":"ContainerStarted","Data":"ec668b2730b22f5a10ced669384d9e1a3bc8bd91f4e2138b3305c211f03be7c7"} Jul 06 22:28:48.501985 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.501894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9f4s" event={"ID":"d2c61271-8422-4b25-b7c8-a128bd188946","Type":"ContainerStarted","Data":"b50947de8218d01cde00aea8cfee66fa7f00c38493bb6da3b1177d3602bbd3f9"} Jul 06 22:28:48.501985 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.501971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:48.503546 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.503522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" event={"ID":"99e76c88-587d-4adb-8b2d-045454871513","Type":"ContainerStarted","Data":"b8c17427af3f5cf7849f13e7f5152d9ee4692cf531729ff4ac972a04756d9764"} Jul 06 22:28:48.503671 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.503570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" event={"ID":"99e76c88-587d-4adb-8b2d-045454871513","Type":"ContainerStarted","Data":"4b83aef47d18a1837449a10b1c21344fbde47f1f72c24b489ac8ffdcd13f4711"} Jul 06 22:28:48.505530 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.505510 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" event={"ID":"fcc975bb-6d05-406a-aaa2-4b279f9ff297","Type":"ContainerStarted","Data":"8959b4de809730d4da9f918bbaad24daf23ae356cd862cee96051dde0967c825"} Jul 06 22:28:48.505636 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.505543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" event={"ID":"fcc975bb-6d05-406a-aaa2-4b279f9ff297","Type":"ContainerStarted","Data":"196ab244bb7eb5adf0b1d8d2defccbeb89a7ffe965a3fdce671d87cd9d6819ac"} Jul 06 22:28:48.505636 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.505569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" event={"ID":"fcc975bb-6d05-406a-aaa2-4b279f9ff297","Type":"ContainerStarted","Data":"02af87d3fec1c6a691490ec2669066c05e43b2343e4e9541f56c3bc993e8d322"} Jul 06 22:28:48.525908 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.525660 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x9f4s" podStartSLOduration=34.567615314 podStartE2EDuration="42.525644009s" totalImagesPullingTime="7.958028695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:48.525259028 +0000 UTC m=+79.040898632" watchObservedRunningTime="2026-07-06 22:28:48.525644009 +0000 UTC m=+79.041283615" Jul 06 22:28:48.526357 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.526308 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9p5mm" podStartSLOduration=72.212659298 podStartE2EDuration="1m16.526297765s" totalImagesPullingTime="4.313638467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:41.500978039 +0000 UTC m=+72.016617645" watchObservedRunningTime="2026-07-06 22:28:48.526297765 +0000 UTC m=+79.041937370" Jul 06 22:28:48.556268 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.556227 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c7446958c-snmd7" podStartSLOduration=2.519729597 podStartE2EDuration="9.556214395s" totalImagesPullingTime="7.036484798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:48.556083304 +0000 UTC m=+79.071722909" watchObservedRunningTime="2026-07-06 22:28:48.556214395 +0000 UTC m=+79.071854000" Jul 06 22:28:48.573831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.573786 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-29v8x" podStartSLOduration=34.63467855 podStartE2EDuration="41.57377112s" totalImagesPullingTime="6.93909257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:48.572308719 +0000 UTC m=+79.087948323" watchObservedRunningTime="2026-07-06 22:28:48.57377112 +0000 UTC m=+79.089410727" Jul 06 22:28:48.587561 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.587537 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:48.793387 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.793255 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:48.857817 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.857762 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ztnl9"] Jul 06 22:28:48.860083 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.860061 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.862485 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.862461 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 22:28:48.862673 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.862649 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kml7g\"" Jul 06 22:28:48.862740 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.862682 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 22:28:48.862974 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.862939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 22:28:48.863064 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.863013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 22:28:48.863402 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.863384 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 22:28:48.863518 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.863411 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 22:28:48.892981 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.892916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:48.966935 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.966904 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:48.981927 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.981908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-tls\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.982056 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.981963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3051b8ca-43a4-49f4-9db0-7deca37fdf90-metrics-client-ca\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.982056 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.982036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-wtmp\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.982169 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.982121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-textfile\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.982209 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.982164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-root\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.982209 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.982196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.982289 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.982231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.982289 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.982254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlkb4\" (UniqueName: \"kubernetes.io/projected/3051b8ca-43a4-49f4-9db0-7deca37fdf90-kube-api-access-vlkb4\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:48.982376 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:48.982288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-sys\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.070968 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.070854 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:49.082871 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.082843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-sys\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083030 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.082909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-tls\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083030 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.082943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3051b8ca-43a4-49f4-9db0-7deca37fdf90-metrics-client-ca\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083030 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.082970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-sys\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083030 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-wtmp\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083284 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-textfile\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083284 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-root\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083284 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083284 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083284 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlkb4\" (UniqueName: \"kubernetes.io/projected/3051b8ca-43a4-49f4-9db0-7deca37fdf90-kube-api-access-vlkb4\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083284 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-root\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083494 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-wtmp\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083621 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3051b8ca-43a4-49f4-9db0-7deca37fdf90-metrics-client-ca\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083863 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-textfile\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.083863 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.083845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-accelerators-collector-config\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.085831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.085807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.085938 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.085811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3051b8ca-43a4-49f4-9db0-7deca37fdf90-node-exporter-tls\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.092146 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.092124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlkb4\" (UniqueName: \"kubernetes.io/projected/3051b8ca-43a4-49f4-9db0-7deca37fdf90-kube-api-access-vlkb4\") pod \"node-exporter-ztnl9\" (UID: \"3051b8ca-43a4-49f4-9db0-7deca37fdf90\") " pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.132438 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.132406 2577 patch_prober.go:28] interesting pod/image-registry-7577f679b8-n6mmc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 22:28:49.132549 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.132463 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" podUID="326b3b47-ab12-40b7-94b0-86b8df9044c1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:28:49.171840 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.171812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ztnl9" Jul 06 22:28:49.177471 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.177443 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:49.184616 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:28:49.184578 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3051b8ca_43a4_49f4_9db0_7deca37fdf90.slice/crio-4819de5202a72a556d0085cdc60866ac79c49d4c5c03b247a629861a55606c37 WatchSource:0}: Error finding container 4819de5202a72a556d0085cdc60866ac79c49d4c5c03b247a629861a55606c37: Status 404 returned error can't find the container with id 4819de5202a72a556d0085cdc60866ac79c49d4c5c03b247a629861a55606c37 Jul 06 22:28:49.273769 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.273729 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:49.370865 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.370775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:49.470460 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.470411 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:49.511146 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.511103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztnl9" event={"ID":"3051b8ca-43a4-49f4-9db0-7deca37fdf90","Type":"ContainerStarted","Data":"4819de5202a72a556d0085cdc60866ac79c49d4c5c03b247a629861a55606c37"} Jul 06 22:28:49.523567 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.523494 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:49.836713 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.836660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:49.925991 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:49.925934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:50.126301 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:50.126223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:51.522058 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:51.522030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pv4fl" event={"ID":"ca36c93c-ba5a-44da-b1bd-326edff908da","Type":"ContainerStarted","Data":"7e4bb6959441d586ae20ee2891fae00399836438e548528a49ca9397ebf43d60"} Jul 06 22:28:51.541985 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:51.541928 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pv4fl" podStartSLOduration=33.500512485 podStartE2EDuration="45.541915217s" totalImagesPullingTime="12.041402732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:28:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:51.541480323 +0000 UTC m=+82.057119926" watchObservedRunningTime="2026-07-06 22:28:51.541915217 +0000 UTC m=+82.057554854" Jul 06 22:28:51.781537 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:51.781473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:51.885384 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:51.885268 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:51.975405 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:51.975367 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:52.060105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:52.060013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:52.531493 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:52.531458 2577 generic.go:356] "Generic (PLEG): container finished" podID="3051b8ca-43a4-49f4-9db0-7deca37fdf90" containerID="6f437c3a68f5cdd5bdc2d0e2be006dd48b556f7b589504e6bc0757b1e97f8d42" exitCode=0 Jul 06 22:28:52.531930 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:52.531555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztnl9" event={"ID":"3051b8ca-43a4-49f4-9db0-7deca37fdf90","Type":"ContainerDied","Data":"6f437c3a68f5cdd5bdc2d0e2be006dd48b556f7b589504e6bc0757b1e97f8d42"} Jul 06 22:28:53.015731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.015703 2577 scope.go:117] "RemoveContainer" containerID="e2f551c773962a7b5a4abb5edbda1756685c5a283101829a3adaa7ab149715ab" Jul 06 22:28:53.527003 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.526967 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:53.537191 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.537162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztnl9" event={"ID":"3051b8ca-43a4-49f4-9db0-7deca37fdf90","Type":"ContainerStarted","Data":"6f360add839adef596c7af7afe524bcfe6b04a5fb02e457c0ec322c4fb8ae589"} Jul 06 22:28:53.537590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.537221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ztnl9" event={"ID":"3051b8ca-43a4-49f4-9db0-7deca37fdf90","Type":"ContainerStarted","Data":"398adff4a1768e290419b61150980c4819366a6ec1aad140b8e2a9ec625ee3f7"} Jul 06 22:28:53.539092 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.539074 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:28:53.539172 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.539120 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-f225l" event={"ID":"ba1f3831-e11d-477f-85d5-e0330cc02f05","Type":"ContainerStarted","Data":"7034ccca9ffcf138ee005cd5f814a63e3422c39a13f51d2cc6aa87049510960a"} Jul 06 22:28:53.539326 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.539309 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:53.560684 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.560645 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ztnl9" podStartSLOduration=3.164646965 podStartE2EDuration="5.560631907s" totalImagesPullingTime="2.332694322s" totalInitContainerRuntime="63.29062ms" isStatefulPod=true podCreationTimestamp="2026-07-06 22:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:53.559773264 +0000 UTC m=+84.075412867" watchObservedRunningTime="2026-07-06 22:28:53.560631907 +0000 UTC m=+84.076271510" Jul 06 22:28:53.580173 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.580131 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-f225l" podStartSLOduration=41.270877761 podStartE2EDuration="46.580118099s" totalImagesPullingTime="5.309240338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:28:53.578785532 +0000 UTC m=+84.094425136" watchObservedRunningTime="2026-07-06 22:28:53.580118099 +0000 UTC m=+84.095757702" Jul 06 22:28:53.596569 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.596548 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-f225l" Jul 06 22:28:53.614696 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.614659 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:53.706761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.706722 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:53.791760 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.791682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:53.935326 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:53.935295 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:54.039071 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:54.039039 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:54.112800 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:54.112727 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:54.259161 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:54.259125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:54.323715 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:54.323683 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:54.665209 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:54.665172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:54.725199 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:54.725169 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:55.116941 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:55.116851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:55.507730 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:55.507697 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:55.667932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:55.667903 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:55.836560 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:55.836481 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:56.495105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:56.495071 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:56.595839 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:56.595804 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:28:58.513922 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:58.513896 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x9f4s" Jul 06 22:28:59.129879 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:59.129852 2577 patch_prober.go:28] interesting pod/image-registry-7577f679b8-n6mmc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 22:28:59.130051 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:59.129900 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" podUID="326b3b47-ab12-40b7-94b0-86b8df9044c1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:28:59.507633 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:59.507595 2577 patch_prober.go:28] interesting pod/image-registry-8655b7bfd9-5gg5b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 22:28:59.507872 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:28:59.507652 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" podUID="ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:29:00.264568 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:00.264536 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:00.318985 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:00.318935 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:02.145166 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:02.145129 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:02.204860 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:02.204831 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:02.481643 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:02.481620 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8655b7bfd9-5gg5b" Jul 06 22:29:02.602788 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:02.602750 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:02.702931 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:02.702901 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:03.556969 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:03.556923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:03.655383 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:03.655353 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:04.149354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.149320 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" podUID="326b3b47-ab12-40b7-94b0-86b8df9044c1" containerName="registry" containerID="cri-o://f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa" gracePeriod=30 Jul 06 22:29:04.276688 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.276660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:04.335926 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.335895 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:04.378552 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.378531 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:29:04.506034 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.505998 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b3b47-ab12-40b7-94b0-86b8df9044c1-ca-trust-extracted\") pod \"326b3b47-ab12-40b7-94b0-86b8df9044c1\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " Jul 06 22:29:04.506223 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506053 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-image-registry-private-configuration\") pod \"326b3b47-ab12-40b7-94b0-86b8df9044c1\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " Jul 06 22:29:04.506223 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506079 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-certificates\") pod \"326b3b47-ab12-40b7-94b0-86b8df9044c1\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " Jul 06 22:29:04.506223 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506104 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq5rx\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-kube-api-access-nq5rx\") pod \"326b3b47-ab12-40b7-94b0-86b8df9044c1\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " Jul 06 22:29:04.506223 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506134 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-installation-pull-secrets\") pod \"326b3b47-ab12-40b7-94b0-86b8df9044c1\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " Jul 06 22:29:04.506223 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506176 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-trusted-ca\") pod \"326b3b47-ab12-40b7-94b0-86b8df9044c1\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " Jul 06 22:29:04.506223 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506204 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") pod \"326b3b47-ab12-40b7-94b0-86b8df9044c1\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " Jul 06 22:29:04.506533 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506232 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-bound-sa-token\") pod \"326b3b47-ab12-40b7-94b0-86b8df9044c1\" (UID: \"326b3b47-ab12-40b7-94b0-86b8df9044c1\") " Jul 06 22:29:04.506627 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506599 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "326b3b47-ab12-40b7-94b0-86b8df9044c1" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:29:04.506985 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.506933 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "326b3b47-ab12-40b7-94b0-86b8df9044c1" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:29:04.508867 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.508838 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-kube-api-access-nq5rx" (OuterVolumeSpecName: "kube-api-access-nq5rx") pod "326b3b47-ab12-40b7-94b0-86b8df9044c1" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1"). InnerVolumeSpecName "kube-api-access-nq5rx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:29:04.508984 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.508938 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "326b3b47-ab12-40b7-94b0-86b8df9044c1" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:29:04.509055 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.508989 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "326b3b47-ab12-40b7-94b0-86b8df9044c1" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:29:04.509055 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.509032 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "326b3b47-ab12-40b7-94b0-86b8df9044c1" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:29:04.509148 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.509125 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "326b3b47-ab12-40b7-94b0-86b8df9044c1" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 22:29:04.515051 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.514943 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326b3b47-ab12-40b7-94b0-86b8df9044c1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "326b3b47-ab12-40b7-94b0-86b8df9044c1" (UID: "326b3b47-ab12-40b7-94b0-86b8df9044c1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:29:04.581469 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.581438 2577 generic.go:356] "Generic (PLEG): container finished" podID="326b3b47-ab12-40b7-94b0-86b8df9044c1" containerID="f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa" exitCode=0 Jul 06 22:29:04.581792 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.581475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" event={"ID":"326b3b47-ab12-40b7-94b0-86b8df9044c1","Type":"ContainerDied","Data":"f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa"} Jul 06 22:29:04.581792 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.581479 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" Jul 06 22:29:04.581792 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.581516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7577f679b8-n6mmc" event={"ID":"326b3b47-ab12-40b7-94b0-86b8df9044c1","Type":"ContainerDied","Data":"ee6a2f1e65b4cb70195acd52e526a458397aa30f0921b575fb9b40879a7375f2"} Jul 06 22:29:04.581792 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.581536 2577 scope.go:117] "RemoveContainer" containerID="f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa" Jul 06 22:29:04.589691 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.589674 2577 scope.go:117] "RemoveContainer" containerID="f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa" Jul 06 22:29:04.589935 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:29:04.589915 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa\": container with ID starting with f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa not found: ID does not exist" containerID="f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa" Jul 06 22:29:04.590084 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.589943 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa"} err="failed to get container status \"f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa\": rpc error: code = NotFound desc = could not find container \"f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa\": container with ID starting with f1b11ce1090d6413f46b447ea91fdb6739527aab01695938e5d8312268662aaa not found: ID does not exist" Jul 06 22:29:04.603541 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.603520 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7577f679b8-n6mmc"] Jul 06 22:29:04.606791 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606772 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-image-registry-private-configuration\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:29:04.606889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606793 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-certificates\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:29:04.606889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606809 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq5rx\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-kube-api-access-nq5rx\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:29:04.606889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606822 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/326b3b47-ab12-40b7-94b0-86b8df9044c1-installation-pull-secrets\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:29:04.606889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606836 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/326b3b47-ab12-40b7-94b0-86b8df9044c1-trusted-ca\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:29:04.606889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606849 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-registry-tls\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:29:04.606889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606863 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/326b3b47-ab12-40b7-94b0-86b8df9044c1-bound-sa-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:29:04.606889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606874 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/326b3b47-ab12-40b7-94b0-86b8df9044c1-ca-trust-extracted\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:29:04.607130 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:04.606891 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7577f679b8-n6mmc"] Jul 06 22:29:05.023904 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:05.023870 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="326b3b47-ab12-40b7-94b0-86b8df9044c1" path="/var/lib/kubelet/pods/326b3b47-ab12-40b7-94b0-86b8df9044c1/volumes" Jul 06 22:29:07.434352 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:07.434321 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bxv7s" Jul 06 22:29:07.686349 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:07.686267 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:07.740635 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:07.740605 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:10.347367 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:10.347325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:10.449552 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:10.449522 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:10.850089 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:10.850048 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:10.909435 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:10.909399 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:11.491540 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:11.491509 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:11.547850 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:11.547815 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:13.271326 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:13.271287 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:13.326689 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:13.326664 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:15.024646 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:15.024615 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:15.126063 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:15.126029 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:15.225968 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:15.225923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:16.300736 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:16.300697 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:16.401998 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:16.401945 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:17.499579 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:17.499549 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:17.601539 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:17.601503 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:19.937233 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:19.937199 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:20.033876 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:20.033841 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:21.698318 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:21.698288 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:21.755342 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:21.755312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:22.610258 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:22.610227 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:22.666494 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:22.666466 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:22.742905 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:22.742868 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:35.698236 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:35.698202 2577 generic.go:356] "Generic (PLEG): container finished" podID="c17a2bef-e938-44e1-9227-049e597e25b7" containerID="a514488f5a8ec03e65a1c3eb17e2c530a52f92d8028f5738ae79406509365623" exitCode=0 Jul 06 22:29:35.698671 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:35.698276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" event={"ID":"c17a2bef-e938-44e1-9227-049e597e25b7","Type":"ContainerDied","Data":"a514488f5a8ec03e65a1c3eb17e2c530a52f92d8028f5738ae79406509365623"} Jul 06 22:29:35.698671 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:35.698556 2577 scope.go:117] "RemoveContainer" containerID="a514488f5a8ec03e65a1c3eb17e2c530a52f92d8028f5738ae79406509365623" Jul 06 22:29:35.704030 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:35.704004 2577 generic.go:356] "Generic (PLEG): container finished" podID="dff7a4cb-8915-4940-ba8a-5239effff1e4" containerID="dc3d394aa674d232d9c8a3a168650f19c3378241457820704c53bcdb3bb8c2d4" exitCode=0 Jul 06 22:29:35.704161 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:35.704067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" event={"ID":"dff7a4cb-8915-4940-ba8a-5239effff1e4","Type":"ContainerDied","Data":"dc3d394aa674d232d9c8a3a168650f19c3378241457820704c53bcdb3bb8c2d4"} Jul 06 22:29:35.704363 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:35.704347 2577 scope.go:117] "RemoveContainer" containerID="dc3d394aa674d232d9c8a3a168650f19c3378241457820704c53bcdb3bb8c2d4" Jul 06 22:29:36.712131 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:36.712099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8wzwv" event={"ID":"dff7a4cb-8915-4940-ba8a-5239effff1e4","Type":"ContainerStarted","Data":"9bb660abf4074d63d838f9c740d5c61e2e4f66050586ed37512dbfd15269ea5a"} Jul 06 22:29:36.713852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:36.713827 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-mgkpz" event={"ID":"c17a2bef-e938-44e1-9227-049e597e25b7","Type":"ContainerStarted","Data":"8be4dc4c2d4e59d0bb1d4eaf5ec76f4bde5834b795866c301d5d29c676725e7f"} Jul 06 22:29:37.609744 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:37.609707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:37.657394 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:37.657356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:56.561972 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:56.561910 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:56.952131 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:56.952090 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:29:59.002914 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:29:59.002879 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:04.939349 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:04.939311 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:05.285664 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:05.285566 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:16.793748 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:16.793711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:16.894633 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:16.894604 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:22.574240 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:22.574144 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:22.673502 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:22.673463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:22.773789 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:22.773756 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:23.324298 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:23.324267 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:23.401834 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:23.401797 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:33.666874 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:33.666834 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:33.831661 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:33.831620 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:33.890051 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:33.890015 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:42.048900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:42.048863 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:42.149213 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:42.149178 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:57.192726 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:57.192688 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:30:57.292664 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:30:57.292634 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:03.779751 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:03.779713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:05.161305 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:05.161256 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:07.409685 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:07.409644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:07.510019 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:07.509978 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:08.776374 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:08.776340 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:08.880303 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:08.880271 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:09.065011 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:09.064909 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:09.172249 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:09.172213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:10.791082 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:10.791054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:11.178406 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:11.178373 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:14.200051 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:14.200009 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:14.255137 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:14.255098 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:15.791075 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:15.791033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:15.886261 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:15.886230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:19.397152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:19.397119 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:25.604108 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:25.604068 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:25.704118 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:25.704091 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:31.542050 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:31.542014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:31.642435 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:31.642397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:33.250094 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:33.250059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:45.409114 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:45.409078 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:45.509048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:45.509018 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.066015 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.065976 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.294075 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.294016 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.392857 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.392784 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.438527 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.438496 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q"] Jul 06 22:31:46.438870 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.438774 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="326b3b47-ab12-40b7-94b0-86b8df9044c1" containerName="registry" Jul 06 22:31:46.438870 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.438786 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="326b3b47-ab12-40b7-94b0-86b8df9044c1" containerName="registry" Jul 06 22:31:46.438870 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.438841 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="326b3b47-ab12-40b7-94b0-86b8df9044c1" containerName="registry" Jul 06 22:31:46.441757 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.441741 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.445061 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.445040 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 22:31:46.445342 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.445324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wb5lr\"" Jul 06 22:31:46.445941 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.445922 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 22:31:46.446052 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.445924 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 22:31:46.447834 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.447817 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 22:31:46.453144 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.453125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q"] Jul 06 22:31:46.536357 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.536336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntvw9\" (UniqueName: \"kubernetes.io/projected/2923c721-0bcb-4f4e-827f-218743b2ab64-kube-api-access-ntvw9\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.536473 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.536365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2923c721-0bcb-4f4e-827f-218743b2ab64-tmp\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.536473 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.536383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2923c721-0bcb-4f4e-827f-218743b2ab64-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.536473 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.536400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2923c721-0bcb-4f4e-827f-218743b2ab64-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.536583 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.536479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2923c721-0bcb-4f4e-827f-218743b2ab64-manifests\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.552913 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.552891 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.637311 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.637286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2923c721-0bcb-4f4e-827f-218743b2ab64-manifests\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.637419 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.637345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntvw9\" (UniqueName: \"kubernetes.io/projected/2923c721-0bcb-4f4e-827f-218743b2ab64-kube-api-access-ntvw9\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.637419 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.637369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2923c721-0bcb-4f4e-827f-218743b2ab64-tmp\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.637419 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.637386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2923c721-0bcb-4f4e-827f-218743b2ab64-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.637419 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.637403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2923c721-0bcb-4f4e-827f-218743b2ab64-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.637708 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.637682 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2923c721-0bcb-4f4e-827f-218743b2ab64-manifests\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.639733 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.639713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2923c721-0bcb-4f4e-827f-218743b2ab64-tmp\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.639856 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.639837 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2923c721-0bcb-4f4e-827f-218743b2ab64-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.639915 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.639892 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2923c721-0bcb-4f4e-827f-218743b2ab64-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.644354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.644309 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntvw9\" (UniqueName: \"kubernetes.io/projected/2923c721-0bcb-4f4e-827f-218743b2ab64-kube-api-access-ntvw9\") pod \"opendatahub-operator-controller-manager-8c9b4d57b-ttz9q\" (UID: \"2923c721-0bcb-4f4e-827f-218743b2ab64\") " pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.653796 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.653771 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.752579 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.752549 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:46.769165 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.769138 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.858065 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.858026 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:46.887806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.887781 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q"] Jul 06 22:31:46.890604 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:31:46.890578 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2923c721_0bcb_4f4e_827f_218743b2ab64.slice/crio-2c536df6b809d99503b152720e2870cd34625e7284540d3b3760c0950f5b1bef WatchSource:0}: Error finding container 2c536df6b809d99503b152720e2870cd34625e7284540d3b3760c0950f5b1bef: Status 404 returned error can't find the container with id 2c536df6b809d99503b152720e2870cd34625e7284540d3b3760c0950f5b1bef Jul 06 22:31:46.954787 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:46.954757 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:47.062030 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:47.061997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:47.162737 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:47.162706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" event={"ID":"2923c721-0bcb-4f4e-827f-218743b2ab64","Type":"ContainerStarted","Data":"2c536df6b809d99503b152720e2870cd34625e7284540d3b3760c0950f5b1bef"} Jul 06 22:31:49.616587 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:49.616549 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:49.701098 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:49.701062 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:31:50.176152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:50.176120 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" event={"ID":"2923c721-0bcb-4f4e-827f-218743b2ab64","Type":"ContainerStarted","Data":"b4ec9aeafb6cc038b4d273cc1223592a67f8d12fdb48ff7f66c9172a827ea06e"} Jul 06 22:31:51.181648 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:51.181616 2577 generic.go:356] "Generic (PLEG): container finished" podID="2923c721-0bcb-4f4e-827f-218743b2ab64" containerID="b4ec9aeafb6cc038b4d273cc1223592a67f8d12fdb48ff7f66c9172a827ea06e" exitCode=0 Jul 06 22:31:51.181999 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:51.181705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" event={"ID":"2923c721-0bcb-4f4e-827f-218743b2ab64","Type":"ContainerDied","Data":"b4ec9aeafb6cc038b4d273cc1223592a67f8d12fdb48ff7f66c9172a827ea06e"} Jul 06 22:31:52.188034 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:52.187995 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" event={"ID":"2923c721-0bcb-4f4e-827f-218743b2ab64","Type":"ContainerStarted","Data":"1292677b315af7fc3ee8852c007cf9ace04e0a6296e8c505a211e1b9b3f0bb7b"} Jul 06 22:31:52.188513 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:52.188096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:31:52.209968 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:31:52.209906 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" podStartSLOduration=1.833035562 podStartE2EDuration="6.209891781s" totalImagesPullingTime="3.280878147s" totalInitContainerRuntime="1.095978072s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:31:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:31:52.207856508 +0000 UTC m=+262.723496113" watchObservedRunningTime="2026-07-06 22:31:52.209891781 +0000 UTC m=+262.725531384" Jul 06 22:32:03.194608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:03.194571 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8c9b4d57b-ttz9q" Jul 06 22:32:05.442871 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.442840 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:05.551763 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.551723 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:05.806732 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.806647 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:05.889168 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.889129 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl"] Jul 06 22:32:05.898357 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.898333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:05.901556 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.901526 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 22:32:05.901696 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.901554 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-crx5m\"" Jul 06 22:32:05.901696 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.901660 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 22:32:05.901696 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.901532 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 22:32:05.901849 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.901825 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 22:32:05.902287 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.902269 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl"] Jul 06 22:32:05.980305 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.980280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjs4\" (UniqueName: \"kubernetes.io/projected/6bb821f2-a090-4361-a790-40a008a1d3f5-kube-api-access-hxjs4\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:05.980447 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.980325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bb821f2-a090-4361-a790-40a008a1d3f5-tls-certs\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:05.980447 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:05.980355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bb821f2-a090-4361-a790-40a008a1d3f5-tmp\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.081731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.081658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjs4\" (UniqueName: \"kubernetes.io/projected/6bb821f2-a090-4361-a790-40a008a1d3f5-kube-api-access-hxjs4\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.081731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.081703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bb821f2-a090-4361-a790-40a008a1d3f5-tls-certs\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.081731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.081724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bb821f2-a090-4361-a790-40a008a1d3f5-tmp\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.082026 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:32:06.081824 2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 06 22:32:06.082026 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:32:06.081910 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bb821f2-a090-4361-a790-40a008a1d3f5-tls-certs podName:6bb821f2-a090-4361-a790-40a008a1d3f5 nodeName:}" failed. No retries permitted until 2026-07-06 22:32:06.581888551 +0000 UTC m=+277.097528148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6bb821f2-a090-4361-a790-40a008a1d3f5-tls-certs") pod "kube-auth-proxy-5cfdb4967c-tcrhl" (UID: "6bb821f2-a090-4361-a790-40a008a1d3f5") : secret "kube-auth-proxy-tls" not found Jul 06 22:32:06.084090 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.084059 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bb821f2-a090-4361-a790-40a008a1d3f5-tmp\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.090126 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.090109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjs4\" (UniqueName: \"kubernetes.io/projected/6bb821f2-a090-4361-a790-40a008a1d3f5-kube-api-access-hxjs4\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.134226 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.134190 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:06.237627 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.237595 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:06.329919 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.329881 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:06.430254 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.430218 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:06.560516 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.560479 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xwdmn"] Jul 06 22:32:06.562722 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.562702 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:06.567614 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.567592 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 22:32:06.573137 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.573105 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:06.586291 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.586268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bb821f2-a090-4361-a790-40a008a1d3f5-tls-certs\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.589052 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.589032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bb821f2-a090-4361-a790-40a008a1d3f5-tls-certs\") pod \"kube-auth-proxy-5cfdb4967c-tcrhl\" (UID: \"6bb821f2-a090-4361-a790-40a008a1d3f5\") " pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.626115 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.626087 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xwdmn"] Jul 06 22:32:06.687118 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.687041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lcpx\" (UniqueName: \"kubernetes.io/projected/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-kube-api-access-4lcpx\") pod \"model-serving-api-54d89bd5fc-xwdmn\" (UID: \"6758f205-a0f3-4a52-b1e9-3dc1fc98700e\") " pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:06.687118 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.687088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-tls-certs\") pod \"model-serving-api-54d89bd5fc-xwdmn\" (UID: \"6758f205-a0f3-4a52-b1e9-3dc1fc98700e\") " pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:06.787994 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.787960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lcpx\" (UniqueName: \"kubernetes.io/projected/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-kube-api-access-4lcpx\") pod \"model-serving-api-54d89bd5fc-xwdmn\" (UID: \"6758f205-a0f3-4a52-b1e9-3dc1fc98700e\") " pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:06.787994 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.788006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-tls-certs\") pod \"model-serving-api-54d89bd5fc-xwdmn\" (UID: \"6758f205-a0f3-4a52-b1e9-3dc1fc98700e\") " pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:06.788226 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:32:06.788124 2577 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 22:32:06.788226 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:32:06.788186 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-tls-certs podName:6758f205-a0f3-4a52-b1e9-3dc1fc98700e nodeName:}" failed. No retries permitted until 2026-07-06 22:32:07.288169814 +0000 UTC m=+277.803809396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-tls-certs") pod "model-serving-api-54d89bd5fc-xwdmn" (UID: "6758f205-a0f3-4a52-b1e9-3dc1fc98700e") : secret "model-serving-api-tls" not found Jul 06 22:32:06.799002 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.798971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lcpx\" (UniqueName: \"kubernetes.io/projected/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-kube-api-access-4lcpx\") pod \"model-serving-api-54d89bd5fc-xwdmn\" (UID: \"6758f205-a0f3-4a52-b1e9-3dc1fc98700e\") " pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:06.808894 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.808862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" Jul 06 22:32:06.947514 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:06.947436 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl"] Jul 06 22:32:06.950482 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:32:06.950451 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb821f2_a090_4361_a790_40a008a1d3f5.slice/crio-ac18762803f680dde0fb0e50af003b5aeb62bf5749b97d2cae91262f97da8726 WatchSource:0}: Error finding container ac18762803f680dde0fb0e50af003b5aeb62bf5749b97d2cae91262f97da8726: Status 404 returned error can't find the container with id ac18762803f680dde0fb0e50af003b5aeb62bf5749b97d2cae91262f97da8726 Jul 06 22:32:07.088644 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:07.088606 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:07.150773 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:07.150737 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:07.240521 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:07.240439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" event={"ID":"6bb821f2-a090-4361-a790-40a008a1d3f5","Type":"ContainerStarted","Data":"ac18762803f680dde0fb0e50af003b5aeb62bf5749b97d2cae91262f97da8726"} Jul 06 22:32:07.291856 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:07.291820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-tls-certs\") pod \"model-serving-api-54d89bd5fc-xwdmn\" (UID: \"6758f205-a0f3-4a52-b1e9-3dc1fc98700e\") " pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:07.294428 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:07.294401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6758f205-a0f3-4a52-b1e9-3dc1fc98700e-tls-certs\") pod \"model-serving-api-54d89bd5fc-xwdmn\" (UID: \"6758f205-a0f3-4a52-b1e9-3dc1fc98700e\") " pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:07.473590 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:07.473553 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:07.606220 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:07.606183 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xwdmn"] Jul 06 22:32:07.609383 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:32:07.609346 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6758f205_a0f3_4a52_b1e9_3dc1fc98700e.slice/crio-9462bce8a1596bc68e6ac7253911197ce7fb50255e818cf404889e65a1d21ab1 WatchSource:0}: Error finding container 9462bce8a1596bc68e6ac7253911197ce7fb50255e818cf404889e65a1d21ab1: Status 404 returned error can't find the container with id 9462bce8a1596bc68e6ac7253911197ce7fb50255e818cf404889e65a1d21ab1 Jul 06 22:32:08.248842 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:08.248777 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" event={"ID":"6758f205-a0f3-4a52-b1e9-3dc1fc98700e","Type":"ContainerStarted","Data":"9462bce8a1596bc68e6ac7253911197ce7fb50255e818cf404889e65a1d21ab1"} Jul 06 22:32:08.307550 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:08.307487 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:10.262000 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:10.261960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" event={"ID":"6758f205-a0f3-4a52-b1e9-3dc1fc98700e","Type":"ContainerStarted","Data":"dbc1f44c79ae0b8d4e698984528bd02968ef603e82132d5ceaf168d8911a7a23"} Jul 06 22:32:10.262424 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:10.262107 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:10.279556 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:10.279492 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" podStartSLOduration=2.603890063 podStartE2EDuration="4.279472599s" totalImagesPullingTime="1.675582536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:10.278237375 +0000 UTC m=+280.793876981" watchObservedRunningTime="2026-07-06 22:32:10.279472599 +0000 UTC m=+280.795112205" Jul 06 22:32:11.267681 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:11.267644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" event={"ID":"6bb821f2-a090-4361-a790-40a008a1d3f5","Type":"ContainerStarted","Data":"c6f708b3ce63d30ad62e1ac6994a3040e45a8f4cfe13cc5e4575195de5c0fff4"} Jul 06 22:32:11.284731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:11.284677 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cfdb4967c-tcrhl" podStartSLOduration=2.820566995 podStartE2EDuration="6.284657571s" totalImagesPullingTime="3.464090576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:11.282561774 +0000 UTC m=+281.798201380" watchObservedRunningTime="2026-07-06 22:32:11.284657571 +0000 UTC m=+281.800297176" Jul 06 22:32:12.875273 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:12.875227 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:12.978647 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:12.978600 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:13.113726 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.113696 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k"] Jul 06 22:32:13.117320 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.117299 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.120283 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.120264 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 22:32:13.120441 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.120424 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p4cj4\"" Jul 06 22:32:13.127928 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.127875 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k"] Jul 06 22:32:13.140236 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.140211 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:13.144400 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g28cv\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-kube-api-access-g28cv\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.144503 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.144503 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.144583 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.144624 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.144659 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.144705 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.144744 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.144784 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.144752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245265 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245265 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245476 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245476 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245476 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g28cv\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-kube-api-access-g28cv\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245617 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245785 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245785 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245888 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245725 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.245888 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.246040 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.245991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.246420 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.246401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.247664 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.247634 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.247753 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.247736 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.257439 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.257384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.258005 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.257986 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g28cv\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-kube-api-access-g28cv\") pod \"data-science-gateway-data-science-gateway-class-548557588-4gj7k\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.427105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.427078 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs"] Jul 06 22:32:13.427251 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.427202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:13.431351 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.431334 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.444639 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.444614 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs"] Jul 06 22:32:13.447280 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.447388 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkxcm\" (UniqueName: \"kubernetes.io/projected/5ed18acf-0c65-4d91-9988-00a2cc67c976-kube-api-access-xkxcm\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.447388 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.448430 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.448430 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.448430 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.448430 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.448430 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.448430 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.447651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ed18acf-0c65-4d91-9988-00a2cc67c976-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.469317 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.469287 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:13.548032 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548176 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548176 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548176 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548176 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548176 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ed18acf-0c65-4d91-9988-00a2cc67c976-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548176 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548541 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkxcm\" (UniqueName: \"kubernetes.io/projected/5ed18acf-0c65-4d91-9988-00a2cc67c976-kube-api-access-xkxcm\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548541 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548651 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548651 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.548890 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.548862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.549112 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.549088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.549525 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.549472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ed18acf-0c65-4d91-9988-00a2cc67c976-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.550885 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.550865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.550989 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.550934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.556151 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.556127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ed18acf-0c65-4d91-9988-00a2cc67c976-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.556532 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.556515 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkxcm\" (UniqueName: \"kubernetes.io/projected/5ed18acf-0c65-4d91-9988-00a2cc67c976-kube-api-access-xkxcm\") pod \"data-science-gateway-data-science-gateway-class-7f964fb67845wrs\" (UID: \"5ed18acf-0c65-4d91-9988-00a2cc67c976\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.564736 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.564684 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k"] Jul 06 22:32:13.566830 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:32:13.566802 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d34460c_1eb0_4ed3_a25c_ca3c3bab74a5.slice/crio-2a1e966e4c95817e340a1f72a9b5a72af791266f730f97158cf6b25b5ebd1f9d WatchSource:0}: Error finding container 2a1e966e4c95817e340a1f72a9b5a72af791266f730f97158cf6b25b5ebd1f9d: Status 404 returned error can't find the container with id 2a1e966e4c95817e340a1f72a9b5a72af791266f730f97158cf6b25b5ebd1f9d Jul 06 22:32:13.567226 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.567203 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:13.757287 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.757202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:13.898601 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:13.898566 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs"] Jul 06 22:32:13.902104 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:32:13.902079 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed18acf_0c65_4d91_9988_00a2cc67c976.slice/crio-5ac9231009494a603d1107e17387605a86e56a891cfc5658181907870eac2e5e WatchSource:0}: Error finding container 5ac9231009494a603d1107e17387605a86e56a891cfc5658181907870eac2e5e: Status 404 returned error can't find the container with id 5ac9231009494a603d1107e17387605a86e56a891cfc5658181907870eac2e5e Jul 06 22:32:14.100735 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.100660 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6"] Jul 06 22:32:14.105196 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.105174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.107690 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.107668 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 22:32:14.107773 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.107668 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 22:32:14.107773 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.107701 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8d2mp\"" Jul 06 22:32:14.107773 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.107690 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 22:32:14.119101 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.119082 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6"] Jul 06 22:32:14.154108 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.154083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.154213 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.154110 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.154213 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.154131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.154213 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.154152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnwhd\" (UniqueName: \"kubernetes.io/projected/33c171f6-b4f1-4840-bfc8-5358f43f43dc-kube-api-access-nnwhd\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.154213 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.154200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33c171f6-b4f1-4840-bfc8-5358f43f43dc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.154340 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.154221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.154340 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.154283 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.255121 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.255091 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.255243 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.255125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.255243 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.255154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.255243 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.255189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwhd\" (UniqueName: \"kubernetes.io/projected/33c171f6-b4f1-4840-bfc8-5358f43f43dc-kube-api-access-nnwhd\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.255402 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.255242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33c171f6-b4f1-4840-bfc8-5358f43f43dc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.255402 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.255284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.255402 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.255333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.256099 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.256071 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.257489 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.257461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.257596 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.257482 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.257596 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.257534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.257708 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.257613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/33c171f6-b4f1-4840-bfc8-5358f43f43dc-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.268440 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.268418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33c171f6-b4f1-4840-bfc8-5358f43f43dc-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.270231 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.270207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnwhd\" (UniqueName: \"kubernetes.io/projected/33c171f6-b4f1-4840-bfc8-5358f43f43dc-kube-api-access-nnwhd\") pod \"istiod-openshift-gateway-94bb8fbfd-lb5k6\" (UID: \"33c171f6-b4f1-4840-bfc8-5358f43f43dc\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.281238 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.281215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" event={"ID":"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5","Type":"ContainerStarted","Data":"2a1e966e4c95817e340a1f72a9b5a72af791266f730f97158cf6b25b5ebd1f9d"} Jul 06 22:32:14.282247 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.282229 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" event={"ID":"5ed18acf-0c65-4d91-9988-00a2cc67c976","Type":"ContainerStarted","Data":"5ac9231009494a603d1107e17387605a86e56a891cfc5658181907870eac2e5e"} Jul 06 22:32:14.414455 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.414424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:14.597660 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:14.597551 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6"] Jul 06 22:32:14.601783 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:32:14.601749 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c171f6_b4f1_4840_bfc8_5358f43f43dc.slice/crio-85c9ab1acf0f993406e7d4eb5e52a591bb3d17ca4d9a779034abe34075cc54e5 WatchSource:0}: Error finding container 85c9ab1acf0f993406e7d4eb5e52a591bb3d17ca4d9a779034abe34075cc54e5: Status 404 returned error can't find the container with id 85c9ab1acf0f993406e7d4eb5e52a591bb3d17ca4d9a779034abe34075cc54e5 Jul 06 22:32:15.289715 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:15.289638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" event={"ID":"33c171f6-b4f1-4840-bfc8-5358f43f43dc","Type":"ContainerStarted","Data":"85c9ab1acf0f993406e7d4eb5e52a591bb3d17ca4d9a779034abe34075cc54e5"} Jul 06 22:32:16.883994 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:16.883934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:17.017980 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.017926 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:17.216162 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.216102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:17.376317 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.376280 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:17.637885 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.637843 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:17.638025 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.637932 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:17.638025 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.637843 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:17.638025 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.638015 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:17.638268 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.638050 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:17.643167 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.643140 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:17.643254 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.643192 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:17.643254 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:17.643225 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:32:18.306025 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.305989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" event={"ID":"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5","Type":"ContainerStarted","Data":"3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6"} Jul 06 22:32:18.307638 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.307608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" event={"ID":"33c171f6-b4f1-4840-bfc8-5358f43f43dc","Type":"ContainerStarted","Data":"e5da21f90ddd8627de7b942337a0b6b588333c1e92355d2104b014799d4067f0"} Jul 06 22:32:18.307795 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.307665 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:18.309472 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.309445 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" event={"ID":"5ed18acf-0c65-4d91-9988-00a2cc67c976","Type":"ContainerStarted","Data":"8ad476f130acf0013c2ef3e3dfcf18bbcd8ebe83ca51a4986e3dc7a5994eb376"} Jul 06 22:32:18.309615 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.309602 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-lb5k6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 22:32:18.309683 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.309650 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" podUID="33c171f6-b4f1-4840-bfc8-5358f43f43dc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 22:32:18.367245 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.367205 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" podStartSLOduration=1.298542677 podStartE2EDuration="5.367190874s" totalImagesPullingTime="4.068648197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:18.364805218 +0000 UTC m=+288.880444824" watchObservedRunningTime="2026-07-06 22:32:18.367190874 +0000 UTC m=+288.882830477" Jul 06 22:32:18.421802 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.421751 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" podStartSLOduration=1.682926378 podStartE2EDuration="5.421736432s" totalImagesPullingTime="3.738810054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:18.41419417 +0000 UTC m=+288.929833775" watchObservedRunningTime="2026-07-06 22:32:18.421736432 +0000 UTC m=+288.937376036" Jul 06 22:32:18.428296 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.428276 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:18.429642 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.429613 2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-4gj7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 06 22:32:18.429715 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.429681 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" podUID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 06 22:32:18.447046 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.447000 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" podStartSLOduration=1.413659778 podStartE2EDuration="4.44698739s" totalImagesPullingTime="3.033327612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:32:18.446477486 +0000 UTC m=+288.962117116" watchObservedRunningTime="2026-07-06 22:32:18.44698739 +0000 UTC m=+288.962626994" Jul 06 22:32:18.595300 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.595220 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:18.691831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.691800 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:18.757825 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.757800 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:18.762455 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.762429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:18.789449 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:18.789407 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:19.313841 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:19.313795 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:19.314315 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:19.314110 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lb5k6" Jul 06 22:32:19.314661 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:19.314642 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb67845wrs" Jul 06 22:32:19.391389 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:19.391357 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k"] Jul 06 22:32:19.428334 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:19.428305 2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-4gj7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 06 22:32:19.428472 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:19.428355 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" podUID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 06 22:32:20.427816 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:20.427780 2577 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-4gj7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jul 06 22:32:20.428299 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:20.427840 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" podUID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jul 06 22:32:21.272212 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:21.272181 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xwdmn" Jul 06 22:32:21.328132 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:21.328091 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" podUID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" containerName="istio-proxy" containerID="cri-o://3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6" gracePeriod=30 Jul 06 22:32:26.569648 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.569612 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:26.652821 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.652754 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g28cv\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-kube-api-access-g28cv\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.652821 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.652793 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istiod-ca-cert\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.653048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.652823 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-certs\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.653048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.652847 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-socket\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.653048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.652871 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-token\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.653048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.652893 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-data\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.653048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.652930 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-envoy\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.653048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.652968 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-credential-socket\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.653048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.653000 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-podinfo\") pod \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\" (UID: \"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5\") " Jul 06 22:32:26.653375 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.653159 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:32:26.653375 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.653256 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:32:26.653375 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.653277 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:26.653523 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.653433 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:32:26.653565 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.653518 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:32:26.653657 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.653633 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:32:26.655121 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.655094 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-kube-api-access-g28cv" (OuterVolumeSpecName: "kube-api-access-g28cv") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "kube-api-access-g28cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:32:26.655224 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.655177 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:32:26.655386 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.655368 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:32:26.655452 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.655429 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" (UID: "6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:32:26.753752 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.753720 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:26.753752 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.753750 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:26.753942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.753761 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:26.753942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.753775 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g28cv\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-kube-api-access-g28cv\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:26.753942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.753788 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:26.753942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.753798 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:26.753942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.753806 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:26.753942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:26.753813 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:32:27.352818 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.352733 2577 generic.go:356] "Generic (PLEG): container finished" podID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" containerID="3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6" exitCode=0 Jul 06 22:32:27.352818 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.352778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" event={"ID":"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5","Type":"ContainerDied","Data":"3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6"} Jul 06 22:32:27.352818 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.352785 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" Jul 06 22:32:27.353054 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.352821 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k" event={"ID":"6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5","Type":"ContainerDied","Data":"2a1e966e4c95817e340a1f72a9b5a72af791266f730f97158cf6b25b5ebd1f9d"} Jul 06 22:32:27.353859 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.352843 2577 scope.go:117] "RemoveContainer" containerID="3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6" Jul 06 22:32:27.362007 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.361990 2577 scope.go:117] "RemoveContainer" containerID="3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6" Jul 06 22:32:27.362248 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:32:27.362232 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6\": container with ID starting with 3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6 not found: ID does not exist" containerID="3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6" Jul 06 22:32:27.362291 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.362256 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6"} err="failed to get container status \"3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6\": rpc error: code = NotFound desc = could not find container \"3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6\": container with ID starting with 3bdf111a0d1d7a27780d736450320163cbaa87355161de1b4e01e8369e1d7cb6 not found: ID does not exist" Jul 06 22:32:27.369373 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.369352 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k"] Jul 06 22:32:27.373337 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:27.373317 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-4gj7k"] Jul 06 22:32:29.020197 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:29.020168 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" path="/var/lib/kubelet/pods/6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5/volumes" Jul 06 22:32:29.832252 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:29.832225 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:32:29.847210 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:29.847184 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:32:29.850897 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:29.850873 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 22:32:51.168854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:51.168819 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:32:52.907391 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:32:52.907355 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:06.970694 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:06.970653 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:07.028639 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.028610 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:07.087611 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.087585 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jd2z"] Jul 06 22:33:07.087884 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.087873 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" containerName="istio-proxy" Jul 06 22:33:07.087931 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.087886 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" containerName="istio-proxy" Jul 06 22:33:07.087981 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.087946 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d34460c-1eb0-4ed3-a25c-ca3c3bab74a5" containerName="istio-proxy" Jul 06 22:33:07.089613 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.089590 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" Jul 06 22:33:07.094450 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.094426 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m9l9l\"" Jul 06 22:33:07.094568 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.094445 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 22:33:07.094568 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.094426 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 22:33:07.110249 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.110222 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jd2z"] Jul 06 22:33:07.176181 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.176145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgnwm\" (UniqueName: \"kubernetes.io/projected/b7a6df83-7c32-4c2c-86c7-8ba2e45def22-kube-api-access-kgnwm\") pod \"kuadrant-operator-catalog-4jd2z\" (UID: \"b7a6df83-7c32-4c2c-86c7-8ba2e45def22\") " pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" Jul 06 22:33:07.210545 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.210511 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:07.277265 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.277196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgnwm\" (UniqueName: \"kubernetes.io/projected/b7a6df83-7c32-4c2c-86c7-8ba2e45def22-kube-api-access-kgnwm\") pod \"kuadrant-operator-catalog-4jd2z\" (UID: \"b7a6df83-7c32-4c2c-86c7-8ba2e45def22\") " pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" Jul 06 22:33:07.285115 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.285089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgnwm\" (UniqueName: \"kubernetes.io/projected/b7a6df83-7c32-4c2c-86c7-8ba2e45def22-kube-api-access-kgnwm\") pod \"kuadrant-operator-catalog-4jd2z\" (UID: \"b7a6df83-7c32-4c2c-86c7-8ba2e45def22\") " pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" Jul 06 22:33:07.398443 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.398419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" Jul 06 22:33:07.451466 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.451439 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jd2z"] Jul 06 22:33:07.525227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.525187 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jd2z"] Jul 06 22:33:07.528034 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:33:07.527928 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a6df83_7c32_4c2c_86c7_8ba2e45def22.slice/crio-0b37db44c48c4cc67998bbc8615377170fd64c1f8c69f9af8c8c76166708ab03 WatchSource:0}: Error finding container 0b37db44c48c4cc67998bbc8615377170fd64c1f8c69f9af8c8c76166708ab03: Status 404 returned error can't find the container with id 0b37db44c48c4cc67998bbc8615377170fd64c1f8c69f9af8c8c76166708ab03 Jul 06 22:33:07.529231 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.529215 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 22:33:07.658641 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.658615 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jh9xm"] Jul 06 22:33:07.661049 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.661033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:07.668700 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.668677 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jh9xm"] Jul 06 22:33:07.781334 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.781274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dzgs\" (UniqueName: \"kubernetes.io/projected/1ccb1c71-c53b-42bd-abcf-7474300d6ad5-kube-api-access-6dzgs\") pod \"kuadrant-operator-catalog-jh9xm\" (UID: \"1ccb1c71-c53b-42bd-abcf-7474300d6ad5\") " pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:07.882064 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.882034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dzgs\" (UniqueName: \"kubernetes.io/projected/1ccb1c71-c53b-42bd-abcf-7474300d6ad5-kube-api-access-6dzgs\") pod \"kuadrant-operator-catalog-jh9xm\" (UID: \"1ccb1c71-c53b-42bd-abcf-7474300d6ad5\") " pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:07.885916 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.885889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:07.889570 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.889553 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dzgs\" (UniqueName: \"kubernetes.io/projected/1ccb1c71-c53b-42bd-abcf-7474300d6ad5-kube-api-access-6dzgs\") pod \"kuadrant-operator-catalog-jh9xm\" (UID: \"1ccb1c71-c53b-42bd-abcf-7474300d6ad5\") " pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:07.970580 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:07.970552 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:08.085694 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:08.085663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:08.094433 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:08.094405 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jh9xm"] Jul 06 22:33:08.097369 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:33:08.097344 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ccb1c71_c53b_42bd_abcf_7474300d6ad5.slice/crio-c6d6e9dc61324a0aa7de41e7d2110bd987d65088e1a2688a7a75830c508e14aa WatchSource:0}: Error finding container c6d6e9dc61324a0aa7de41e7d2110bd987d65088e1a2688a7a75830c508e14aa: Status 404 returned error can't find the container with id c6d6e9dc61324a0aa7de41e7d2110bd987d65088e1a2688a7a75830c508e14aa Jul 06 22:33:08.217249 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:08.217221 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:08.530795 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:08.530761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" event={"ID":"b7a6df83-7c32-4c2c-86c7-8ba2e45def22","Type":"ContainerStarted","Data":"0b37db44c48c4cc67998bbc8615377170fd64c1f8c69f9af8c8c76166708ab03"} Jul 06 22:33:08.531986 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:08.531933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" event={"ID":"1ccb1c71-c53b-42bd-abcf-7474300d6ad5","Type":"ContainerStarted","Data":"c6d6e9dc61324a0aa7de41e7d2110bd987d65088e1a2688a7a75830c508e14aa"} Jul 06 22:33:10.542864 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:10.542819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" event={"ID":"1ccb1c71-c53b-42bd-abcf-7474300d6ad5","Type":"ContainerStarted","Data":"bd961acc6288c825d28660f9b74702d8c11c88f8c143ee8583e87e5ea3c99874"} Jul 06 22:33:10.544109 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:10.544088 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" event={"ID":"b7a6df83-7c32-4c2c-86c7-8ba2e45def22","Type":"ContainerStarted","Data":"4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f"} Jul 06 22:33:10.544175 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:10.544154 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" podUID="b7a6df83-7c32-4c2c-86c7-8ba2e45def22" containerName="registry-server" containerID="cri-o://4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f" gracePeriod=2 Jul 06 22:33:10.559119 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:10.559071 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" podStartSLOduration=1.91734469 podStartE2EDuration="3.559029802s" totalImagesPullingTime="1.641685112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:33:10.556807691 +0000 UTC m=+341.072447295" watchObservedRunningTime="2026-07-06 22:33:10.559029802 +0000 UTC m=+341.074669407" Jul 06 22:33:10.571757 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:10.571716 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" podStartSLOduration=1.363376873 podStartE2EDuration="3.571702952s" totalImagesPullingTime="2.208326079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:33:10.571286378 +0000 UTC m=+341.086926011" watchObservedRunningTime="2026-07-06 22:33:10.571702952 +0000 UTC m=+341.087342555" Jul 06 22:33:10.783941 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:10.783911 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" Jul 06 22:33:10.909869 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:10.909842 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgnwm\" (UniqueName: \"kubernetes.io/projected/b7a6df83-7c32-4c2c-86c7-8ba2e45def22-kube-api-access-kgnwm\") pod \"b7a6df83-7c32-4c2c-86c7-8ba2e45def22\" (UID: \"b7a6df83-7c32-4c2c-86c7-8ba2e45def22\") " Jul 06 22:33:10.911986 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:10.911935 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a6df83-7c32-4c2c-86c7-8ba2e45def22-kube-api-access-kgnwm" (OuterVolumeSpecName: "kube-api-access-kgnwm") pod "b7a6df83-7c32-4c2c-86c7-8ba2e45def22" (UID: "b7a6df83-7c32-4c2c-86c7-8ba2e45def22"). InnerVolumeSpecName "kube-api-access-kgnwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:33:11.010374 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.010348 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgnwm\" (UniqueName: \"kubernetes.io/projected/b7a6df83-7c32-4c2c-86c7-8ba2e45def22-kube-api-access-kgnwm\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:33:11.549813 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.549777 2577 generic.go:356] "Generic (PLEG): container finished" podID="b7a6df83-7c32-4c2c-86c7-8ba2e45def22" containerID="4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f" exitCode=0 Jul 06 22:33:11.550235 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.549828 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" Jul 06 22:33:11.550235 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.549860 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" event={"ID":"b7a6df83-7c32-4c2c-86c7-8ba2e45def22","Type":"ContainerDied","Data":"4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f"} Jul 06 22:33:11.550235 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.549918 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4jd2z" event={"ID":"b7a6df83-7c32-4c2c-86c7-8ba2e45def22","Type":"ContainerDied","Data":"0b37db44c48c4cc67998bbc8615377170fd64c1f8c69f9af8c8c76166708ab03"} Jul 06 22:33:11.550235 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.549943 2577 scope.go:117] "RemoveContainer" containerID="4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f" Jul 06 22:33:11.558815 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.558797 2577 scope.go:117] "RemoveContainer" containerID="4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f" Jul 06 22:33:11.559151 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:33:11.559132 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f\": container with ID starting with 4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f not found: ID does not exist" containerID="4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f" Jul 06 22:33:11.559234 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.559158 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f"} err="failed to get container status \"4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f\": rpc error: code = NotFound desc = could not find container \"4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f\": container with ID starting with 4d21f445ea7c77aabd86ae2bacd93ecb2b4134aba6001ddc28b94a6689b2d10f not found: ID does not exist" Jul 06 22:33:11.566458 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.566436 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jd2z"] Jul 06 22:33:11.571831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:11.571812 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jd2z"] Jul 06 22:33:13.019893 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:13.019861 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7a6df83-7c32-4c2c-86c7-8ba2e45def22" path="/var/lib/kubelet/pods/b7a6df83-7c32-4c2c-86c7-8ba2e45def22/volumes" Jul 06 22:33:17.971060 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:17.971029 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:17.971524 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:17.971079 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:17.993509 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:17.993484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:18.602536 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:18.602511 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jh9xm" Jul 06 22:33:36.186150 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:36.186115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:38.831334 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.831300 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj"] Jul 06 22:33:38.831696 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.831622 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a6df83-7c32-4c2c-86c7-8ba2e45def22" containerName="registry-server" Jul 06 22:33:38.831696 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.831635 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a6df83-7c32-4c2c-86c7-8ba2e45def22" containerName="registry-server" Jul 06 22:33:38.831770 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.831720 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a6df83-7c32-4c2c-86c7-8ba2e45def22" containerName="registry-server" Jul 06 22:33:38.838638 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.838619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" Jul 06 22:33:38.840784 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.840765 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 22:33:38.840880 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.840797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nqb6k\"" Jul 06 22:33:38.847909 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.847884 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj"] Jul 06 22:33:38.925195 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:38.925166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdmlg\" (UniqueName: \"kubernetes.io/projected/83499374-05bb-4210-90a5-6b87728a9272-kube-api-access-sdmlg\") pod \"dns-operator-controller-manager-864dd78c4c-7rlxj\" (UID: \"83499374-05bb-4210-90a5-6b87728a9272\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" Jul 06 22:33:39.026218 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:39.026190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdmlg\" (UniqueName: \"kubernetes.io/projected/83499374-05bb-4210-90a5-6b87728a9272-kube-api-access-sdmlg\") pod \"dns-operator-controller-manager-864dd78c4c-7rlxj\" (UID: \"83499374-05bb-4210-90a5-6b87728a9272\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" Jul 06 22:33:39.033901 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:39.033880 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdmlg\" (UniqueName: \"kubernetes.io/projected/83499374-05bb-4210-90a5-6b87728a9272-kube-api-access-sdmlg\") pod \"dns-operator-controller-manager-864dd78c4c-7rlxj\" (UID: \"83499374-05bb-4210-90a5-6b87728a9272\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" Jul 06 22:33:39.149851 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:39.149759 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" Jul 06 22:33:39.274585 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:39.274562 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj"] Jul 06 22:33:39.277358 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:33:39.277334 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83499374_05bb_4210_90a5_6b87728a9272.slice/crio-73434855630d2e22ca761d8030df1b6ca85f5cce4737b916d5194f6b14b36b6f WatchSource:0}: Error finding container 73434855630d2e22ca761d8030df1b6ca85f5cce4737b916d5194f6b14b36b6f: Status 404 returned error can't find the container with id 73434855630d2e22ca761d8030df1b6ca85f5cce4737b916d5194f6b14b36b6f Jul 06 22:33:39.664891 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:39.664857 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" event={"ID":"83499374-05bb-4210-90a5-6b87728a9272","Type":"ContainerStarted","Data":"73434855630d2e22ca761d8030df1b6ca85f5cce4737b916d5194f6b14b36b6f"} Jul 06 22:33:40.382170 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:40.382125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:41.676106 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:41.676069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" event={"ID":"83499374-05bb-4210-90a5-6b87728a9272","Type":"ContainerStarted","Data":"e383eb28806643d829e7aae22f30532639225134b5a1a693fed0ff241109a1a2"} Jul 06 22:33:41.676517 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:41.676202 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" Jul 06 22:33:41.693968 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:41.693899 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" podStartSLOduration=1.87117568 podStartE2EDuration="3.693884412s" totalImagesPullingTime="1.822708732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:33:41.692341015 +0000 UTC m=+372.207980621" watchObservedRunningTime="2026-07-06 22:33:41.693884412 +0000 UTC m=+372.209524020" Jul 06 22:33:42.248048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.248018 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r"] Jul 06 22:33:42.251200 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.251184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:33:42.253862 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.253843 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5q4kh\"" Jul 06 22:33:42.260743 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.260720 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r"] Jul 06 22:33:42.355641 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.355613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxjx\" (UniqueName: \"kubernetes.io/projected/949b6abd-425b-460a-b07e-74ec99044f36-kube-api-access-hjxjx\") pod \"limitador-operator-controller-manager-859d7b78bd-gvl2r\" (UID: \"949b6abd-425b-460a-b07e-74ec99044f36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:33:42.456740 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.456713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxjx\" (UniqueName: \"kubernetes.io/projected/949b6abd-425b-460a-b07e-74ec99044f36-kube-api-access-hjxjx\") pod \"limitador-operator-controller-manager-859d7b78bd-gvl2r\" (UID: \"949b6abd-425b-460a-b07e-74ec99044f36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:33:42.464799 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.464768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxjx\" (UniqueName: \"kubernetes.io/projected/949b6abd-425b-460a-b07e-74ec99044f36-kube-api-access-hjxjx\") pod \"limitador-operator-controller-manager-859d7b78bd-gvl2r\" (UID: \"949b6abd-425b-460a-b07e-74ec99044f36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:33:42.561879 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.561815 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:33:42.695905 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.695883 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r"] Jul 06 22:33:42.697745 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:33:42.697719 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949b6abd_425b_460a_b07e_74ec99044f36.slice/crio-917f836b676ef460725df93ad85e7090db39587d2b8ee47f3faeb4b3aecc1e99 WatchSource:0}: Error finding container 917f836b676ef460725df93ad85e7090db39587d2b8ee47f3faeb4b3aecc1e99: Status 404 returned error can't find the container with id 917f836b676ef460725df93ad85e7090db39587d2b8ee47f3faeb4b3aecc1e99 Jul 06 22:33:42.824467 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:42.824390 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:43.022216 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:43.022185 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:43.685229 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:43.685197 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" event={"ID":"949b6abd-425b-460a-b07e-74ec99044f36","Type":"ContainerStarted","Data":"917f836b676ef460725df93ad85e7090db39587d2b8ee47f3faeb4b3aecc1e99"} Jul 06 22:33:44.320198 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:44.320173 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:44.691291 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:44.691255 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" event={"ID":"949b6abd-425b-460a-b07e-74ec99044f36","Type":"ContainerStarted","Data":"72099957ad2db46f9093a32403bcb3ea53acb1b2b587d05dbdce6343ca69208c"} Jul 06 22:33:44.691438 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:44.691403 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:33:44.709994 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:44.709933 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" podStartSLOduration=1.177631202 podStartE2EDuration="2.709917243s" totalImagesPullingTime="1.532286041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:33:44.707842853 +0000 UTC m=+375.223482458" watchObservedRunningTime="2026-07-06 22:33:44.709917243 +0000 UTC m=+375.225556847" Jul 06 22:33:47.381784 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:47.381744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:47.839301 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:47.839269 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:48.028627 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:48.028583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:50.380197 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.380165 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb"] Jul 06 22:33:50.383488 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.383470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" Jul 06 22:33:50.385689 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.385671 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9hfpx\"" Jul 06 22:33:50.397430 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.397409 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb"] Jul 06 22:33:50.525379 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.525355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nlpn\" (UniqueName: \"kubernetes.io/projected/6927399c-f018-4ee6-a93b-d46659aadc72-kube-api-access-7nlpn\") pod \"authorino-operator-75cc8d5cb7-8dzhb\" (UID: \"6927399c-f018-4ee6-a93b-d46659aadc72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" Jul 06 22:33:50.626493 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.626452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nlpn\" (UniqueName: \"kubernetes.io/projected/6927399c-f018-4ee6-a93b-d46659aadc72-kube-api-access-7nlpn\") pod \"authorino-operator-75cc8d5cb7-8dzhb\" (UID: \"6927399c-f018-4ee6-a93b-d46659aadc72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" Jul 06 22:33:50.635753 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.635672 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nlpn\" (UniqueName: \"kubernetes.io/projected/6927399c-f018-4ee6-a93b-d46659aadc72-kube-api-access-7nlpn\") pod \"authorino-operator-75cc8d5cb7-8dzhb\" (UID: \"6927399c-f018-4ee6-a93b-d46659aadc72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" Jul 06 22:33:50.693147 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.693121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" Jul 06 22:33:50.810296 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.810266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:50.823616 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:50.823592 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb"] Jul 06 22:33:50.826103 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:33:50.826081 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6927399c_f018_4ee6_a93b_d46659aadc72.slice/crio-1879c867a778e7ab27c2f63e3525e1d7167f692a3026292896e41f41483aae58 WatchSource:0}: Error finding container 1879c867a778e7ab27c2f63e3525e1d7167f692a3026292896e41f41483aae58: Status 404 returned error can't find the container with id 1879c867a778e7ab27c2f63e3525e1d7167f692a3026292896e41f41483aae58 Jul 06 22:33:51.721562 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:51.721510 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" event={"ID":"6927399c-f018-4ee6-a93b-d46659aadc72","Type":"ContainerStarted","Data":"1879c867a778e7ab27c2f63e3525e1d7167f692a3026292896e41f41483aae58"} Jul 06 22:33:52.190463 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:52.190423 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:52.290368 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:52.290319 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:52.683097 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:52.683071 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7rlxj" Jul 06 22:33:53.733820 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:53.733767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" event={"ID":"6927399c-f018-4ee6-a93b-d46659aadc72","Type":"ContainerStarted","Data":"edeb3e9b33ff0057602de610c443f65e033fb67e5c3419b8d813ffe4ad82911f"} Jul 06 22:33:53.734292 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:53.734137 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" Jul 06 22:33:53.749936 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:53.749889 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" podStartSLOduration=1.668060409 podStartE2EDuration="3.749875671s" totalImagesPullingTime="2.081815262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:33:53.748620197 +0000 UTC m=+384.264259802" watchObservedRunningTime="2026-07-06 22:33:53.749875671 +0000 UTC m=+384.265515274" Jul 06 22:33:55.273549 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:55.273517 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:55.415562 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:55.415519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:55.697001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:55.696974 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:33:55.996252 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:55.996167 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:56.106448 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:56.106417 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:59.409967 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:59.409897 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:33:59.541900 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:33:59.541853 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:04.741768 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:04.741731 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8dzhb" Jul 06 22:34:05.602741 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.602709 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r"] Jul 06 22:34:05.602925 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.602902 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" podUID="949b6abd-425b-460a-b07e-74ec99044f36" containerName="manager" containerID="cri-o://72099957ad2db46f9093a32403bcb3ea53acb1b2b587d05dbdce6343ca69208c" gracePeriod=2 Jul 06 22:34:05.613062 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.613036 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r"] Jul 06 22:34:05.661513 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.661486 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl"] Jul 06 22:34:05.661817 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.661805 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949b6abd-425b-460a-b07e-74ec99044f36" containerName="manager" Jul 06 22:34:05.661861 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.661819 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="949b6abd-425b-460a-b07e-74ec99044f36" containerName="manager" Jul 06 22:34:05.661895 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.661879 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="949b6abd-425b-460a-b07e-74ec99044f36" containerName="manager" Jul 06 22:34:05.664691 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.664675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" Jul 06 22:34:05.678263 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.678239 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl"] Jul 06 22:34:05.692059 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:34:05.692025 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gvl2r\" is forbidden: User \"system:node:ip-10-0-132-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-3.ec2.internal' and this object" podUID="949b6abd-425b-460a-b07e-74ec99044f36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:34:05.793847 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.793813 2577 generic.go:356] "Generic (PLEG): container finished" podID="949b6abd-425b-460a-b07e-74ec99044f36" containerID="72099957ad2db46f9093a32403bcb3ea53acb1b2b587d05dbdce6343ca69208c" exitCode=0 Jul 06 22:34:05.841093 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.841074 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:34:05.842937 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:34:05.842913 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gvl2r\" is forbidden: User \"system:node:ip-10-0-132-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-3.ec2.internal' and this object" podUID="949b6abd-425b-460a-b07e-74ec99044f36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:34:05.852374 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.852347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6pg8\" (UniqueName: \"kubernetes.io/projected/87a2dc5d-4ef7-4564-a8f9-3970b558b6f2-kube-api-access-x6pg8\") pod \"limitador-operator-controller-manager-859d7b78bd-hlnfl\" (UID: \"87a2dc5d-4ef7-4564-a8f9-3970b558b6f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" Jul 06 22:34:05.953448 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.953425 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjxjx\" (UniqueName: \"kubernetes.io/projected/949b6abd-425b-460a-b07e-74ec99044f36-kube-api-access-hjxjx\") pod \"949b6abd-425b-460a-b07e-74ec99044f36\" (UID: \"949b6abd-425b-460a-b07e-74ec99044f36\") " Jul 06 22:34:05.953551 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.953536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6pg8\" (UniqueName: \"kubernetes.io/projected/87a2dc5d-4ef7-4564-a8f9-3970b558b6f2-kube-api-access-x6pg8\") pod \"limitador-operator-controller-manager-859d7b78bd-hlnfl\" (UID: \"87a2dc5d-4ef7-4564-a8f9-3970b558b6f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" Jul 06 22:34:05.955345 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.955325 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/949b6abd-425b-460a-b07e-74ec99044f36-kube-api-access-hjxjx" (OuterVolumeSpecName: "kube-api-access-hjxjx") pod "949b6abd-425b-460a-b07e-74ec99044f36" (UID: "949b6abd-425b-460a-b07e-74ec99044f36"). InnerVolumeSpecName "kube-api-access-hjxjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:34:05.963611 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.963591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6pg8\" (UniqueName: \"kubernetes.io/projected/87a2dc5d-4ef7-4564-a8f9-3970b558b6f2-kube-api-access-x6pg8\") pod \"limitador-operator-controller-manager-859d7b78bd-hlnfl\" (UID: \"87a2dc5d-4ef7-4564-a8f9-3970b558b6f2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" Jul 06 22:34:05.986493 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:05.986470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" Jul 06 22:34:06.054209 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.054180 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjxjx\" (UniqueName: \"kubernetes.io/projected/949b6abd-425b-460a-b07e-74ec99044f36-kube-api-access-hjxjx\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:34:06.115126 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.115097 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl"] Jul 06 22:34:06.117676 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:34:06.117651 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a2dc5d_4ef7_4564_a8f9_3970b558b6f2.slice/crio-088cd632640e69137bc8ebc84ce2a6b2227b51b37abbef37ff3cb86d7ba88318 WatchSource:0}: Error finding container 088cd632640e69137bc8ebc84ce2a6b2227b51b37abbef37ff3cb86d7ba88318: Status 404 returned error can't find the container with id 088cd632640e69137bc8ebc84ce2a6b2227b51b37abbef37ff3cb86d7ba88318 Jul 06 22:34:06.695588 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.695546 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" podUID="949b6abd-425b-460a-b07e-74ec99044f36" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.28:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 22:34:06.799488 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.799465 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:34:06.799903 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.799492 2577 scope.go:117] "RemoveContainer" containerID="72099957ad2db46f9093a32403bcb3ea53acb1b2b587d05dbdce6343ca69208c" Jul 06 22:34:06.801437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.801413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" event={"ID":"87a2dc5d-4ef7-4564-a8f9-3970b558b6f2","Type":"ContainerStarted","Data":"12da774a59787fbdd5a037e8b7a96204a9f44eb03127ae8c0aafbd0564bef457"} Jul 06 22:34:06.801592 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.801462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" event={"ID":"87a2dc5d-4ef7-4564-a8f9-3970b558b6f2","Type":"ContainerStarted","Data":"088cd632640e69137bc8ebc84ce2a6b2227b51b37abbef37ff3cb86d7ba88318"} Jul 06 22:34:06.801592 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.801527 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" Jul 06 22:34:06.801704 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:34:06.801616 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gvl2r\" is forbidden: User \"system:node:ip-10-0-132-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-3.ec2.internal' and this object" podUID="949b6abd-425b-460a-b07e-74ec99044f36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:34:06.817037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:06.816996 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" podStartSLOduration=1.816983428 podStartE2EDuration="1.816983428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:06.816087882 +0000 UTC m=+397.331727498" watchObservedRunningTime="2026-07-06 22:34:06.816983428 +0000 UTC m=+397.332623032" Jul 06 22:34:06.817767 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:34:06.817742 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gvl2r\" is forbidden: User \"system:node:ip-10-0-132-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-3.ec2.internal' and this object" podUID="949b6abd-425b-460a-b07e-74ec99044f36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:34:06.819431 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:34:06.819407 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gvl2r\" is forbidden: User \"system:node:ip-10-0-132-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-3.ec2.internal' and this object" podUID="949b6abd-425b-460a-b07e-74ec99044f36" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gvl2r" Jul 06 22:34:07.020416 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:07.020338 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="949b6abd-425b-460a-b07e-74ec99044f36" path="/var/lib/kubelet/pods/949b6abd-425b-460a-b07e-74ec99044f36/volumes" Jul 06 22:34:07.819364 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:07.819333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:07.923873 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:07.923835 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:10.318663 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:10.318629 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:10.423399 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:10.423357 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:13.133232 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:13.133197 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:13.233700 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:13.233650 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:13.909541 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:13.909494 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:14.004026 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:14.003986 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:14.110768 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:14.110730 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:14.168721 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:14.168644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:14.655458 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:14.655379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:14.707001 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:14.706972 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:16.661430 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:16.661395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:16.763279 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:16.763231 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:17.814083 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:17.814050 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hlnfl" Jul 06 22:34:18.382667 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:18.382632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:24.823191 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:24.823139 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:24.923545 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:24.923501 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:24.977785 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:24.977755 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:25.555888 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:25.555851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:25.655451 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:25.655420 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:28.155245 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:28.155215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:28.255608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:28.255553 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:31.366690 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:31.366650 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:31.467347 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:31.467316 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:34.374632 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.374596 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc"] Jul 06 22:34:34.382489 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.382468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.384799 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.384782 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-grzx9\"" Jul 06 22:34:34.390079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.390058 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc"] Jul 06 22:34:34.397801 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.397770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:34.468634 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.468599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.468822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.468665 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8rsw\" (UniqueName: \"kubernetes.io/projected/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-kube-api-access-m8rsw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.468822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.468746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.468822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.468782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.468822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.468815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.469036 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.468906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.469036 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.468937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.469036 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.469000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.469141 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.469034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.569541 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8rsw\" (UniqueName: \"kubernetes.io/projected/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-kube-api-access-m8rsw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.569725 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.569725 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.569725 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.569725 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.569725 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.570006 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.570006 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.570006 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.569839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.570529 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.570475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.570645 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.570581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.570645 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.570631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.570938 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.570918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.571347 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.571321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.577517 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.577492 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.578469 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.578445 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8rsw\" (UniqueName: \"kubernetes.io/projected/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-kube-api-access-m8rsw\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.579004 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.578985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.579262 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.579240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-d76dc\" (UID: \"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.693455 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.693426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:34.826807 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.826780 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc"] Jul 06 22:34:34.829131 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:34:34.829100 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb8e6dc_ae26_46f6_92a4_e87af6bc4fda.slice/crio-d8d68cf2b808a7226809b0dc28a0f252d4d0cbac4357c39750f2b3349f282e7d WatchSource:0}: Error finding container d8d68cf2b808a7226809b0dc28a0f252d4d0cbac4357c39750f2b3349f282e7d: Status 404 returned error can't find the container with id d8d68cf2b808a7226809b0dc28a0f252d4d0cbac4357c39750f2b3349f282e7d Jul 06 22:34:34.831480 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.831431 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:34:34.831579 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.831523 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:34:34.831579 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.831565 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:34:34.852268 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.852245 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:34.927644 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.927606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" event={"ID":"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda","Type":"ContainerStarted","Data":"9caf3bdd73e46cb71798c504d6617d8ff1e5271f907cc58fd8f2d1eb8285d04d"} Jul 06 22:34:34.927829 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.927664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" event={"ID":"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda","Type":"ContainerStarted","Data":"d8d68cf2b808a7226809b0dc28a0f252d4d0cbac4357c39750f2b3349f282e7d"} Jul 06 22:34:34.949765 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.949666 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" podStartSLOduration=0.949646197 podStartE2EDuration="949.646197ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:34:34.946919628 +0000 UTC m=+425.462559231" watchObservedRunningTime="2026-07-06 22:34:34.949646197 +0000 UTC m=+425.465285802" Jul 06 22:34:34.960227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:34.960199 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:35.015320 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:35.015283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:35.694638 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:35.694605 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:35.699280 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:35.699257 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:35.932077 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:35.932048 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:35.932833 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:35.932815 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:34:43.966641 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:43.966598 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:44.067262 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:44.067230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:44.135380 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:44.135345 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:47.384999 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:47.384940 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:47.487138 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:47.487094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:47.585781 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:47.585748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:48.183369 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:48.183333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:34:48.249932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:34:48.249883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:07.858340 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:07.858249 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:19.624854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:19.624809 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:19.764230 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:19.764186 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:26.369514 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:26.369475 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:26.465385 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:26.465347 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:26.558469 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:26.558428 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:26.617422 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:26.617388 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:29.217555 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:29.217513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:35:29.306311 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:35:29.306277 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:04.117636 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:04.117598 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:04.575048 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:04.574996 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:04.773042 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:04.773003 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:05.036261 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:05.036207 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:05.147327 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:05.147287 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:12.358498 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:12.358471 2577 generic.go:356] "Generic (PLEG): container finished" podID="bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda" containerID="9caf3bdd73e46cb71798c504d6617d8ff1e5271f907cc58fd8f2d1eb8285d04d" exitCode=0 Jul 06 22:36:12.358810 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:12.358538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" event={"ID":"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda","Type":"ContainerDied","Data":"9caf3bdd73e46cb71798c504d6617d8ff1e5271f907cc58fd8f2d1eb8285d04d"} Jul 06 22:36:12.358942 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:12.358925 2577 scope.go:117] "RemoveContainer" containerID="9caf3bdd73e46cb71798c504d6617d8ff1e5271f907cc58fd8f2d1eb8285d04d" Jul 06 22:36:12.359885 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:12.359857 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:36:12.360000 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:12.359939 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:36:12.360092 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:12.360007 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:36:13.367933 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:13.367897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" event={"ID":"bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda","Type":"ContainerStarted","Data":"10907b9b34152fdf99ff113d9946a0e501d4d6b76df47d714f1b38abd6dabee9"} Jul 06 22:36:13.694250 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:13.694216 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:36:13.694540 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:13.694517 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-d76dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 06 22:36:13.694594 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:13.694567 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" podUID="bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 06 22:36:14.569850 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:14.569807 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:14.668445 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:14.668393 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:14.694506 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:14.694476 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-d76dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 06 22:36:14.694645 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:14.694528 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" podUID="bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 06 22:36:15.694764 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:15.694729 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-d76dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 06 22:36:15.695161 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:15.694787 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" podUID="bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 06 22:36:16.694152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:16.694114 2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-d76dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 06 22:36:16.694331 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:16.694184 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" podUID="bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 06 22:36:17.698039 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:17.698002 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:36:17.698473 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:17.698322 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:36:17.699040 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:17.699023 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-d76dc" Jul 06 22:36:20.618169 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:20.618134 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:24.630462 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:24.630379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:48.624192 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:48.624152 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:56.678608 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.678578 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7"] Jul 06 22:36:56.681935 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.681911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.684886 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.684861 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 22:36:56.685070 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.684893 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5xqsk\"" Jul 06 22:36:56.685070 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.684921 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 22:36:56.685070 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.684861 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 22:36:56.692315 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.692292 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7"] Jul 06 22:36:56.699196 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.699172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:36:56.836008 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.835980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.836152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.836024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6efc7530-516d-4b52-a945-682380f75510-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.836152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.836059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.836152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.836085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.836152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.836112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.836152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.836136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssjvv\" (UniqueName: \"kubernetes.io/projected/6efc7530-516d-4b52-a945-682380f75510-kube-api-access-ssjvv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.937440 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.937368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssjvv\" (UniqueName: \"kubernetes.io/projected/6efc7530-516d-4b52-a945-682380f75510-kube-api-access-ssjvv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.937440 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.937408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.937613 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.937531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6efc7530-516d-4b52-a945-682380f75510-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.937613 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.937581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.937684 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.937614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.937684 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.937656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.937976 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.937940 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.938038 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.937989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.938107 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.938088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.939775 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.939753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6efc7530-516d-4b52-a945-682380f75510-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.939935 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.939920 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6efc7530-516d-4b52-a945-682380f75510-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.944734 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.944709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssjvv\" (UniqueName: \"kubernetes.io/projected/6efc7530-516d-4b52-a945-682380f75510-kube-api-access-ssjvv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dbnc7\" (UID: \"6efc7530-516d-4b52-a945-682380f75510\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:56.993695 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:56.993673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:36:57.119843 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:57.119820 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7"] Jul 06 22:36:57.121734 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:36:57.121705 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efc7530_516d_4b52_a945_682380f75510.slice/crio-2bfa3b4a64e735f7df837cd8f4028d77d3ee8d4c2f9d32181812f052ed6e430e WatchSource:0}: Error finding container 2bfa3b4a64e735f7df837cd8f4028d77d3ee8d4c2f9d32181812f052ed6e430e: Status 404 returned error can't find the container with id 2bfa3b4a64e735f7df837cd8f4028d77d3ee8d4c2f9d32181812f052ed6e430e Jul 06 22:36:57.553495 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:57.553421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" event={"ID":"6efc7530-516d-4b52-a945-682380f75510","Type":"ContainerStarted","Data":"2bfa3b4a64e735f7df837cd8f4028d77d3ee8d4c2f9d32181812f052ed6e430e"} Jul 06 22:36:58.559201 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:58.559110 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" event={"ID":"6efc7530-516d-4b52-a945-682380f75510","Type":"ContainerStarted","Data":"3247d817dd6b51791a95a25e74ffa5b95e44a9f7e664b842fd3c322e6f2c3b79"} Jul 06 22:36:58.576305 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:36:58.576263 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" podStartSLOduration=1.5373161770000001 podStartE2EDuration="2.576248209s" totalImagesPullingTime="1.038932032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:36:58.575344244 +0000 UTC m=+569.090983871" watchObservedRunningTime="2026-07-06 22:36:58.576248209 +0000 UTC m=+569.091887813" Jul 06 22:37:06.994198 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:06.994163 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:37:06.994620 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:06.994229 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:37:07.006597 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:07.006574 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:37:07.609560 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:07.609530 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dbnc7" Jul 06 22:37:08.940679 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:08.940637 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:37:08.993562 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:08.993529 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:37:16.580308 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:16.580276 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:37:25.284063 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.284024 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s"] Jul 06 22:37:25.287475 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.287453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.289605 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.289570 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 22:37:25.296357 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.296336 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s"] Jul 06 22:37:25.314135 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.314109 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:37:25.343450 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.343415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.343554 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.343460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.343594 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.343554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.343594 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.343588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.343675 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.343606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xvvd\" (UniqueName: \"kubernetes.io/projected/0f5f777b-9c23-4e9a-a3e5-f000afc40206-kube-api-access-7xvvd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.343675 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.343659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f5f777b-9c23-4e9a-a3e5-f000afc40206-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.444856 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.444827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f5f777b-9c23-4e9a-a3e5-f000afc40206-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.445037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.444907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.445037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.444932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.445037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.444993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.445037 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.445030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.445264 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.445054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xvvd\" (UniqueName: \"kubernetes.io/projected/0f5f777b-9c23-4e9a-a3e5-f000afc40206-kube-api-access-7xvvd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.445534 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.445502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.445683 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.445543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.445683 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.445559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.447296 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.447267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f5f777b-9c23-4e9a-a3e5-f000afc40206-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.447412 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.447397 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f5f777b-9c23-4e9a-a3e5-f000afc40206-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.452271 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.452249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xvvd\" (UniqueName: \"kubernetes.io/projected/0f5f777b-9c23-4e9a-a3e5-f000afc40206-kube-api-access-7xvvd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s\" (UID: \"0f5f777b-9c23-4e9a-a3e5-f000afc40206\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.599131 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.599047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:25.728141 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:25.728118 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s"] Jul 06 22:37:25.730171 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:37:25.730140 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5f777b_9c23_4e9a_a3e5_f000afc40206.slice/crio-7682308edd329d49779703201feb7589098152fb0b43b1305607c4e7ada946db WatchSource:0}: Error finding container 7682308edd329d49779703201feb7589098152fb0b43b1305607c4e7ada946db: Status 404 returned error can't find the container with id 7682308edd329d49779703201feb7589098152fb0b43b1305607c4e7ada946db Jul 06 22:37:26.680523 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:26.680482 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" event={"ID":"0f5f777b-9c23-4e9a-a3e5-f000afc40206","Type":"ContainerStarted","Data":"eca2e5b626d95c8195bdaf7430f8752d05ab61732cdd25569f7fe4ad625db1fb"} Jul 06 22:37:26.680888 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:26.680540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" event={"ID":"0f5f777b-9c23-4e9a-a3e5-f000afc40206","Type":"ContainerStarted","Data":"7682308edd329d49779703201feb7589098152fb0b43b1305607c4e7ada946db"} Jul 06 22:37:26.697857 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:26.697810 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" podStartSLOduration=1.521522677 podStartE2EDuration="1.697795217s" totalImagesPullingTime="176.27254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:37:26.696571903 +0000 UTC m=+597.212211508" watchObservedRunningTime="2026-07-06 22:37:26.697795217 +0000 UTC m=+597.213434821" Jul 06 22:37:29.867388 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:29.867359 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:37:29.874247 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:29.874224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:37:32.496253 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:32.496216 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:37:35.315881 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:35.315836 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:37:35.599808 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:35.599726 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:35.599996 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:35.599812 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:35.611887 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:35.611865 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:37:35.732505 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:37:35.732475 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s" Jul 06 22:38:09.714207 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:38:09.714172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:31.240658 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:38:31.240627 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:31.350207 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:38:31.350167 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:32.480628 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:38:32.480572 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:38:32.563821 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:38:32.563785 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:01.492790 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:39:01.492756 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:42.830019 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:39:42.829923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:39:44.417740 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:39:44.417700 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:18.557167 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:18.557128 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:18.690374 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:18.690337 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:18.818844 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:18.818764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:24.866414 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:24.866377 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:24.985504 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:24.985473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:25.081990 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:25.081933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:25.232034 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:25.231997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:31.482539 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:31.482505 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:31.562476 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:31.562448 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:57.606029 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:57.605919 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:40:57.706071 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:40:57.706031 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:42:29.895805 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:42:29.895722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:42:29.905480 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:42:29.905459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:42:55.613829 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:42:55.613785 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:45:01.937010 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:45:01.936972 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:45:26.033701 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:45:26.033630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:45:59.924308 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:45:59.924268 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:46:00.025659 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:46:00.025628 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:47:29.922531 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:47:29.922497 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:47:29.930936 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:47:29.930914 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:50:05.150020 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:50:05.149924 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:05.523641 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:05.523607 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:11.609612 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:11.609574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:19.072111 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:19.072078 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:21.682206 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:21.682173 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:27.351008 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:27.350970 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:32.518529 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:32.518493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:32.782056 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:32.781970 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:35.405126 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:35.405084 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:35.503383 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:35.503352 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:35.863469 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:35.863436 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:41.783786 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:41.783752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:41.837642 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:41.837612 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:41.963227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:41.963198 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp"] Jul 06 22:51:41.966551 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:41.966531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:41.968822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:41.968803 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3194e430-openshift-default-dockercfg-jtmdq\"" Jul 06 22:51:41.985421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:41.985398 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp"] Jul 06 22:51:41.991025 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:41.991005 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:42.058464 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.058386 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:42.152071 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67575991-5f93-4607-87eb-2aff38d976d9-istio-podinfo\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.152252 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67575991-5f93-4607-87eb-2aff38d976d9-istiod-ca-cert\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.152252 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-certs\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.152252 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-credential-socket\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.152252 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-socket\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.152428 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-envoy\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.152428 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55cd8\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-kube-api-access-55cd8\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.152428 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-data\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.152428 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.152386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-istio-token\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253255 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67575991-5f93-4607-87eb-2aff38d976d9-istio-podinfo\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253399 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67575991-5f93-4607-87eb-2aff38d976d9-istiod-ca-cert\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253399 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-certs\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253515 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-credential-socket\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253515 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-socket\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253515 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-envoy\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253682 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55cd8\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-kube-api-access-55cd8\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253682 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-data\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253682 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-istio-token\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253836 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-certs\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253836 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-socket\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.253836 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-credential-socket\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.254015 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.253998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-data\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.254064 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.254033 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67575991-5f93-4607-87eb-2aff38d976d9-istiod-ca-cert\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.255749 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.255730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-envoy\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.255891 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.255873 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67575991-5f93-4607-87eb-2aff38d976d9-istio-podinfo\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.260897 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.260867 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-istio-token\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.261026 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.260993 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55cd8\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-kube-api-access-55cd8\") pod \"e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.277062 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.277043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:42.405770 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.405747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp"] Jul 06 22:51:42.408472 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:51:42.408444 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67575991_5f93_4607_87eb_2aff38d976d9.slice/crio-dcced71f340fd766a8708817e8dc1d72a28b581d155c87b479822d48d145a7d8 WatchSource:0}: Error finding container dcced71f340fd766a8708817e8dc1d72a28b581d155c87b479822d48d145a7d8: Status 404 returned error can't find the container with id dcced71f340fd766a8708817e8dc1d72a28b581d155c87b479822d48d145a7d8 Jul 06 22:51:42.410684 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.410650 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:51:42.410763 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.410731 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:51:42.410763 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.410755 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:51:42.472544 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.472521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" event={"ID":"67575991-5f93-4607-87eb-2aff38d976d9","Type":"ContainerStarted","Data":"9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18"} Jul 06 22:51:42.472645 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.472576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" event={"ID":"67575991-5f93-4607-87eb-2aff38d976d9","Type":"ContainerStarted","Data":"dcced71f340fd766a8708817e8dc1d72a28b581d155c87b479822d48d145a7d8"} Jul 06 22:51:42.492170 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:42.492125 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" podStartSLOduration=1.492109238 podStartE2EDuration="1.492109238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:51:42.489285182 +0000 UTC m=+1453.004924787" watchObservedRunningTime="2026-07-06 22:51:42.492109238 +0000 UTC m=+1453.007748843" Jul 06 22:51:43.086635 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.086602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:43.168052 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.168023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:43.231390 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.231361 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:43.277538 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.277508 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:43.282275 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.282257 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:43.304915 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.304886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:43.477440 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.477415 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:43.478445 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.478428 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:43.632196 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.632166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:43.736452 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:43.736379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:45.667941 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:45.667912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:48.248421 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:48.248377 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:48.404803 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:48.404774 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp"] Jul 06 22:51:48.405041 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:48.404994 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" podUID="67575991-5f93-4607-87eb-2aff38d976d9" containerName="istio-proxy" containerID="cri-o://9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18" gracePeriod=30 Jul 06 22:51:48.428713 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:48.428682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:48.562927 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:48.562841 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:48.631879 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:48.631854 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:50.218219 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:50.218188 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:53.852355 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.852328 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:53.944304 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944274 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67575991-5f93-4607-87eb-2aff38d976d9-istiod-ca-cert\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944457 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944308 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55cd8\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-kube-api-access-55cd8\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944457 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944339 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-certs\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944457 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944379 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-istio-token\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944457 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944400 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-credential-socket\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944457 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944446 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-envoy\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944717 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944481 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-socket\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944717 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944549 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67575991-5f93-4607-87eb-2aff38d976d9-istio-podinfo\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944717 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944574 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:53.944717 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944605 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-data\") pod \"67575991-5f93-4607-87eb-2aff38d976d9\" (UID: \"67575991-5f93-4607-87eb-2aff38d976d9\") " Jul 06 22:51:53.944922 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944791 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67575991-5f93-4607-87eb-2aff38d976d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:51:53.944922 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.944870 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:53.945057 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.945043 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:53.945194 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.945067 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67575991-5f93-4607-87eb-2aff38d976d9-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:53.945194 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.945062 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:53.945194 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.945080 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:53.945814 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.945784 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:53.946654 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.946625 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-kube-api-access-55cd8" (OuterVolumeSpecName: "kube-api-access-55cd8") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "kube-api-access-55cd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:51:53.946884 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.946860 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:51:53.946992 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.946879 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:51:53.946992 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:53.946902 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67575991-5f93-4607-87eb-2aff38d976d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67575991-5f93-4607-87eb-2aff38d976d9" (UID: "67575991-5f93-4607-87eb-2aff38d976d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:51:54.046631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.046455 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67575991-5f93-4607-87eb-2aff38d976d9-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:54.046631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.046488 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:54.046631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.046502 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55cd8\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-kube-api-access-55cd8\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:54.046631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.046524 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67575991-5f93-4607-87eb-2aff38d976d9-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:54.046631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.046538 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:54.046631 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.046551 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67575991-5f93-4607-87eb-2aff38d976d9-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:51:54.532754 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.532724 2577 generic.go:356] "Generic (PLEG): container finished" podID="67575991-5f93-4607-87eb-2aff38d976d9" containerID="9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18" exitCode=0 Jul 06 22:51:54.532910 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.532770 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" Jul 06 22:51:54.532910 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.532805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" event={"ID":"67575991-5f93-4607-87eb-2aff38d976d9","Type":"ContainerDied","Data":"9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18"} Jul 06 22:51:54.532910 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.532865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp" event={"ID":"67575991-5f93-4607-87eb-2aff38d976d9","Type":"ContainerDied","Data":"dcced71f340fd766a8708817e8dc1d72a28b581d155c87b479822d48d145a7d8"} Jul 06 22:51:54.532910 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.532889 2577 scope.go:117] "RemoveContainer" containerID="9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18" Jul 06 22:51:54.542227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.542204 2577 scope.go:117] "RemoveContainer" containerID="9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18" Jul 06 22:51:54.547283 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:51:54.547101 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18\": container with ID starting with 9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18 not found: ID does not exist" containerID="9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18" Jul 06 22:51:54.547283 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.547144 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18"} err="failed to get container status \"9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18\": rpc error: code = NotFound desc = could not find container \"9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18\": container with ID starting with 9f3f3a67b26d3ac5a8584df39d371aa13750ade5af4935345498032e04525c18 not found: ID does not exist" Jul 06 22:51:54.556840 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.556802 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp"] Jul 06 22:51:54.558972 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.558935 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3194e430-openshift-default-85b5f777c7-nbrfp"] Jul 06 22:51:54.961613 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:54.961577 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:55.021612 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.021580 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67575991-5f93-4607-87eb-2aff38d976d9" path="/var/lib/kubelet/pods/67575991-5f93-4607-87eb-2aff38d976d9/volumes" Jul 06 22:51:55.062434 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.062405 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:55.125517 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.125480 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x"] Jul 06 22:51:55.126066 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.126021 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67575991-5f93-4607-87eb-2aff38d976d9" containerName="istio-proxy" Jul 06 22:51:55.126066 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.126053 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="67575991-5f93-4607-87eb-2aff38d976d9" containerName="istio-proxy" Jul 06 22:51:55.126266 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.126158 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="67575991-5f93-4607-87eb-2aff38d976d9" containerName="istio-proxy" Jul 06 22:51:55.129041 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.129012 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.131372 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.131355 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-31d40b50-openshift-default-dockercfg-mcbfc\"" Jul 06 22:51:55.142437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.142414 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x"] Jul 06 22:51:55.158374 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-credential-socket\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.158464 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd2039b1-d544-4c8d-994f-1496c4549930-istio-podinfo\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.158464 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd2039b1-d544-4c8d-994f-1496c4549930-istiod-ca-cert\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.158567 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-data\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.158567 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158527 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-socket\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.158567 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-istio-token\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.158690 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bmqz\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-kube-api-access-2bmqz\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.158690 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-envoy\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.158776 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.158703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-certs\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.202655 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.202628 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:55.259596 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd2039b1-d544-4c8d-994f-1496c4549930-istiod-ca-cert\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.259596 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-data\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.259596 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-socket\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.259856 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-istio-token\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.259856 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bmqz\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-kube-api-access-2bmqz\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.259995 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-envoy\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.259995 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259891 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-certs\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.259995 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-socket\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.259995 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.259947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-credential-socket\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.260260 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.260004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd2039b1-d544-4c8d-994f-1496c4549930-istio-podinfo\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.260260 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.260020 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-data\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.260260 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.260237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-certs\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.260429 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.260348 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-credential-socket\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.260429 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.260384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd2039b1-d544-4c8d-994f-1496c4549930-istiod-ca-cert\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.262174 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.262148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-envoy\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.262396 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.262375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd2039b1-d544-4c8d-994f-1496c4549930-istio-podinfo\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.267915 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.267896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-istio-token\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.268375 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.268354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bmqz\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-kube-api-access-2bmqz\") pod \"e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.298834 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.298810 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:55.442899 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.442866 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:55.582751 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.582729 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x"] Jul 06 22:51:55.584792 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:51:55.584765 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2039b1_d544_4c8d_994f_1496c4549930.slice/crio-1e477b8880f5bb24457de308a21d75d5b5d288acf38fd0d6f26871c70b909f27 WatchSource:0}: Error finding container 1e477b8880f5bb24457de308a21d75d5b5d288acf38fd0d6f26871c70b909f27: Status 404 returned error can't find the container with id 1e477b8880f5bb24457de308a21d75d5b5d288acf38fd0d6f26871c70b909f27 Jul 06 22:51:55.587025 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.586990 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:51:55.587132 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.587069 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:51:55.587132 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:55.587113 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:51:56.262409 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.262374 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:56.353810 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.353780 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:56.419523 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.419479 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:56.548125 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.548029 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" event={"ID":"dd2039b1-d544-4c8d-994f-1496c4549930","Type":"ContainerStarted","Data":"0f5634a1a9de31bd4402ac786aa206933d9856096d739a5742e58bb79bba1ced"} Jul 06 22:51:56.548125 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.548096 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" event={"ID":"dd2039b1-d544-4c8d-994f-1496c4549930","Type":"ContainerStarted","Data":"1e477b8880f5bb24457de308a21d75d5b5d288acf38fd0d6f26871c70b909f27"} Jul 06 22:51:56.569228 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.569178 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" podStartSLOduration=1.569161322 podStartE2EDuration="1.569161322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:51:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:51:56.568576005 +0000 UTC m=+1467.084215610" watchObservedRunningTime="2026-07-06 22:51:56.569161322 +0000 UTC m=+1467.084800988" Jul 06 22:51:56.767603 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.767570 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:56.865475 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.865397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:56.979806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:56.979771 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:51:57.443884 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:57.443856 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:57.448253 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:57.448230 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:57.552789 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:57.552762 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:57.553696 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:57.553674 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:51:58.376723 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:51:58.376697 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:01.451088 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:01.451053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:01.850468 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:01.850378 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:07.496567 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.496533 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x"] Jul 06 22:52:07.496998 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.496736 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" podUID="dd2039b1-d544-4c8d-994f-1496c4549930" containerName="istio-proxy" containerID="cri-o://0f5634a1a9de31bd4402ac786aa206933d9856096d739a5742e58bb79bba1ced" gracePeriod=30 Jul 06 22:52:07.520077 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.520038 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:07.615433 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.615392 2577 generic.go:356] "Generic (PLEG): container finished" podID="dd2039b1-d544-4c8d-994f-1496c4549930" containerID="0f5634a1a9de31bd4402ac786aa206933d9856096d739a5742e58bb79bba1ced" exitCode=0 Jul 06 22:52:07.615584 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.615460 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" event={"ID":"dd2039b1-d544-4c8d-994f-1496c4549930","Type":"ContainerDied","Data":"0f5634a1a9de31bd4402ac786aa206933d9856096d739a5742e58bb79bba1ced"} Jul 06 22:52:07.620060 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.620025 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:07.639271 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.639253 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:52:07.773478 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773407 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-credential-socket\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.773478 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773446 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bmqz\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-kube-api-access-2bmqz\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.773731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773501 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd2039b1-d544-4c8d-994f-1496c4549930-istio-podinfo\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.773731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773524 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-data\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.773731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773555 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-istio-token\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.773731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773588 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-certs\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.773731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773686 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-socket\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.773731 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773709 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:07.774078 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773726 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd2039b1-d544-4c8d-994f-1496c4549930-istiod-ca-cert\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.774078 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.773799 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-envoy\") pod \"dd2039b1-d544-4c8d-994f-1496c4549930\" (UID: \"dd2039b1-d544-4c8d-994f-1496c4549930\") " Jul 06 22:52:07.774078 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.774044 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:07.774226 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.774072 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd2039b1-d544-4c8d-994f-1496c4549930-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:52:07.774226 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.774184 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:07.774226 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.774201 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd2039b1-d544-4c8d-994f-1496c4549930-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:07.774226 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.774215 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:07.774419 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.774308 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:07.774419 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.774320 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:07.775727 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.775701 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-kube-api-access-2bmqz" (OuterVolumeSpecName: "kube-api-access-2bmqz") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "kube-api-access-2bmqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:52:07.775859 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.775837 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:07.776035 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.776011 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:52:07.776138 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.776120 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd2039b1-d544-4c8d-994f-1496c4549930-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd2039b1-d544-4c8d-994f-1496c4549930" (UID: "dd2039b1-d544-4c8d-994f-1496c4549930"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:52:07.874991 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.874968 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:07.874991 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.874990 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bmqz\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-kube-api-access-2bmqz\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:07.875128 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.875002 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd2039b1-d544-4c8d-994f-1496c4549930-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:07.875128 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.875010 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:07.875128 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.875018 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd2039b1-d544-4c8d-994f-1496c4549930-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:07.875128 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:07.875026 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd2039b1-d544-4c8d-994f-1496c4549930-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:08.621990 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:08.621945 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" Jul 06 22:52:08.622432 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:08.621986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x" event={"ID":"dd2039b1-d544-4c8d-994f-1496c4549930","Type":"ContainerDied","Data":"1e477b8880f5bb24457de308a21d75d5b5d288acf38fd0d6f26871c70b909f27"} Jul 06 22:52:08.622432 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:08.622059 2577 scope.go:117] "RemoveContainer" containerID="0f5634a1a9de31bd4402ac786aa206933d9856096d739a5742e58bb79bba1ced" Jul 06 22:52:08.645169 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:08.645146 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x"] Jul 06 22:52:08.648982 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:08.648943 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-31d40b50-openshift-default-7974f8f6b9-p5z4x"] Jul 06 22:52:09.020693 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:09.020661 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd2039b1-d544-4c8d-994f-1496c4549930" path="/var/lib/kubelet/pods/dd2039b1-d544-4c8d-994f-1496c4549930/volumes" Jul 06 22:52:13.359485 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.359452 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:13.424937 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.424863 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:13.551515 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.551478 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz"] Jul 06 22:52:13.552042 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.552026 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd2039b1-d544-4c8d-994f-1496c4549930" containerName="istio-proxy" Jul 06 22:52:13.552104 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.552046 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd2039b1-d544-4c8d-994f-1496c4549930" containerName="istio-proxy" Jul 06 22:52:13.552143 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.552114 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd2039b1-d544-4c8d-994f-1496c4549930" containerName="istio-proxy" Jul 06 22:52:13.555028 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.555010 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.557433 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.557412 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-aacf6a80-openshift-default-dockercfg-7qvws\"" Jul 06 22:52:13.567026 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.567005 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz"] Jul 06 22:52:13.580212 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.580188 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:13.620209 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-token\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.620209 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620183 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-credential-socket\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.620401 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istiod-ca-cert\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.620401 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-certs\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.620401 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-envoy\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.620512 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-socket\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.620512 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-data\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.620512 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-podinfo\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.620512 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.620489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v99jn\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-kube-api-access-v99jn\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.721830 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.721798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-credential-socket\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.721830 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.721832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istiod-ca-cert\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.721860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-certs\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.721895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-envoy\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.721946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-socket\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-data\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722281 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-podinfo\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722281 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v99jn\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-kube-api-access-v99jn\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722362 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-token\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722362 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722281 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-certs\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722362 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-credential-socket\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722769 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istiod-ca-cert\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722769 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-data\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.722947 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.722834 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-socket\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.724283 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.724263 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-envoy\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.724525 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.724506 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-podinfo\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.730431 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.730408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-token\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.730629 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.730605 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v99jn\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-kube-api-access-v99jn\") pod \"e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.865971 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.865927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:13.998025 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:13.997999 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz"] Jul 06 22:52:13.999836 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:52:13.999812 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5acdc3a7_7633_4756_aecb_9cfb2d58f621.slice/crio-75ef8185338238a0623b1c1ccf7f70e38946a13bc98f282aec7e0a207bd57e0b WatchSource:0}: Error finding container 75ef8185338238a0623b1c1ccf7f70e38946a13bc98f282aec7e0a207bd57e0b: Status 404 returned error can't find the container with id 75ef8185338238a0623b1c1ccf7f70e38946a13bc98f282aec7e0a207bd57e0b Jul 06 22:52:14.002119 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.002079 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:52:14.002189 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.002173 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:52:14.002233 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.002220 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:52:14.649961 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.649908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" event={"ID":"5acdc3a7-7633-4756-aecb-9cfb2d58f621","Type":"ContainerStarted","Data":"e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5"} Jul 06 22:52:14.650341 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.649995 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" event={"ID":"5acdc3a7-7633-4756-aecb-9cfb2d58f621","Type":"ContainerStarted","Data":"75ef8185338238a0623b1c1ccf7f70e38946a13bc98f282aec7e0a207bd57e0b"} Jul 06 22:52:14.670520 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.670472 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" podStartSLOduration=1.670456755 podStartE2EDuration="1.670456755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:52:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:52:14.669109511 +0000 UTC m=+1485.184749128" watchObservedRunningTime="2026-07-06 22:52:14.670456755 +0000 UTC m=+1485.186096358" Jul 06 22:52:14.778409 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.778376 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:14.866212 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.866172 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:14.935386 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:14.935355 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:15.047629 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:15.047589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:15.141350 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:15.141318 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:15.871219 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:15.871188 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:16.497894 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:16.497857 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:16.599878 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:16.599847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:16.659680 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:16.659659 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:16.660486 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:16.660467 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:18.231480 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:18.231435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.180840 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:20.180810 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.368115 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:20.368082 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz"] Jul 06 22:52:20.368326 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:20.368303 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" podUID="5acdc3a7-7633-4756-aecb-9cfb2d58f621" containerName="istio-proxy" containerID="cri-o://e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5" gracePeriod=30 Jul 06 22:52:20.390264 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:20.390243 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.488405 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:20.488332 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:20.546454 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:20.546418 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:21.891468 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:21.891437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:26.027915 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.027889 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:26.140801 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.140722 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v99jn\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-kube-api-access-v99jn\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.140801 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.140790 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-certs\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.141038 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.140861 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-credential-socket\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.141038 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.140889 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istiod-ca-cert\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.141038 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.140912 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-data\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.141038 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.140937 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-socket\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.141038 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.140999 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-token\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.141311 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.141038 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-podinfo\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.141311 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.141098 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-envoy\") pod \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\" (UID: \"5acdc3a7-7633-4756-aecb-9cfb2d58f621\") " Jul 06 22:52:26.141311 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.141149 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:26.141467 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.141361 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:26.141467 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.141382 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.141662 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.141635 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:52:26.141662 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.141648 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:26.142064 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.142027 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-data" (OuterVolumeSpecName: "istio-data") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:26.143482 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.143456 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:52:26.143482 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.143473 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-kube-api-access-v99jn" (OuterVolumeSpecName: "kube-api-access-v99jn") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "kube-api-access-v99jn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:52:26.143593 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.143512 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-token" (OuterVolumeSpecName: "istio-token") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:52:26.143593 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.143513 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5acdc3a7-7633-4756-aecb-9cfb2d58f621" (UID: "5acdc3a7-7633-4756-aecb-9cfb2d58f621"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:52:26.170021 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.169989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:26.230720 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.230696 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:26.242016 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.241996 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.242067 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.242016 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.242067 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.242027 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.242067 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.242036 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.242067 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.242044 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.242067 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.242050 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.242067 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.242057 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5acdc3a7-7633-4756-aecb-9cfb2d58f621-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.242067 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.242065 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v99jn\" (UniqueName: \"kubernetes.io/projected/5acdc3a7-7633-4756-aecb-9cfb2d58f621-kube-api-access-v99jn\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:52:26.681690 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.681655 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:26.705653 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.705622 2577 generic.go:356] "Generic (PLEG): container finished" podID="5acdc3a7-7633-4756-aecb-9cfb2d58f621" containerID="e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5" exitCode=0 Jul 06 22:52:26.705791 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.705666 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" Jul 06 22:52:26.705791 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.705708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" event={"ID":"5acdc3a7-7633-4756-aecb-9cfb2d58f621","Type":"ContainerDied","Data":"e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5"} Jul 06 22:52:26.705791 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.705762 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz" event={"ID":"5acdc3a7-7633-4756-aecb-9cfb2d58f621","Type":"ContainerDied","Data":"75ef8185338238a0623b1c1ccf7f70e38946a13bc98f282aec7e0a207bd57e0b"} Jul 06 22:52:26.705791 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.705786 2577 scope.go:117] "RemoveContainer" containerID="e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5" Jul 06 22:52:26.716613 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.716593 2577 scope.go:117] "RemoveContainer" containerID="e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5" Jul 06 22:52:26.716927 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:52:26.716896 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5\": container with ID starting with e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5 not found: ID does not exist" containerID="e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5" Jul 06 22:52:26.717017 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.716937 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5"} err="failed to get container status \"e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5\": rpc error: code = NotFound desc = could not find container \"e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5\": container with ID starting with e25c8a8f0a031b20ba38f91bcad1bbe9c13fcd5f50c3effc18faeae177aedac5 not found: ID does not exist" Jul 06 22:52:26.744228 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.744192 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz"] Jul 06 22:52:26.753557 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.753525 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-aacf6a80-openshift-default-86586f7847-p7rvz"] Jul 06 22:52:26.790648 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.790605 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:26.855882 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:26.855839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:27.027269 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:27.027195 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5acdc3a7-7633-4756-aecb-9cfb2d58f621" path="/var/lib/kubelet/pods/5acdc3a7-7633-4756-aecb-9cfb2d58f621/volumes" Jul 06 22:52:28.266052 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:28.266021 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:29.950092 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:29.950065 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:52:29.955035 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:29.955013 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:52:34.450759 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:34.450692 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:34.633262 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:34.633228 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:34.748860 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:34.748757 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:52:35.225450 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:52:35.225417 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:01.176248 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:01.176209 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:08.282222 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:08.282157 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:08.417205 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:08.417155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:08.669368 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:08.669342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:24.580317 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:24.580265 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:30.637689 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:30.637648 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:30.742505 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:30.742466 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:30.837595 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:30.837506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:41.360085 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:41.360052 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:42.172544 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:42.172507 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:48.245450 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:48.245414 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:48.298494 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:48.298466 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:48.382413 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:48.382385 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:48.482647 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:48.482615 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:48.584387 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:48.584320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:49.322076 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:49.322047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:49.419645 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:49.419616 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:49.520342 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:49.520302 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:51.117487 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:51.117452 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:57.086693 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:57.086660 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:57.184853 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:57.184795 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:53:57.763833 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:53:57.763803 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:03.972370 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:03.972333 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:04.074165 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.074113 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:04.210298 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.210241 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:04.490245 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.490214 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96"] Jul 06 22:54:04.490578 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.490558 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5acdc3a7-7633-4756-aecb-9cfb2d58f621" containerName="istio-proxy" Jul 06 22:54:04.490578 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.490576 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5acdc3a7-7633-4756-aecb-9cfb2d58f621" containerName="istio-proxy" Jul 06 22:54:04.490759 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.490667 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5acdc3a7-7633-4756-aecb-9cfb2d58f621" containerName="istio-proxy" Jul 06 22:54:04.493669 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.493652 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.495752 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.495735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b80e969c-openshift-default-dockercfg-f45k5\"" Jul 06 22:54:04.515506 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.515481 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96"] Jul 06 22:54:04.518044 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.518023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:04.633476 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49f7a333-98ba-45d7-913d-ec715140df0d-istiod-ca-cert\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.633774 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-envoy\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.633774 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-socket\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.633774 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-certs\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.633774 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-istio-token\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.633774 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-data\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.633774 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldbx6\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-kube-api-access-ldbx6\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.633774 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-credential-socket\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.634034 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.633783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49f7a333-98ba-45d7-913d-ec715140df0d-istio-podinfo\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.686095 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.686068 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:04.735105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-istio-token\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735250 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-data\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735250 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldbx6\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-kube-api-access-ldbx6\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735250 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-credential-socket\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735362 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49f7a333-98ba-45d7-913d-ec715140df0d-istio-podinfo\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735362 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49f7a333-98ba-45d7-913d-ec715140df0d-istiod-ca-cert\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735474 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-envoy\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735474 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-socket\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735474 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-certs\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735625 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735545 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-data\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735689 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-credential-socket\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735831 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735805 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-certs\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.735935 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.735882 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-socket\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.736158 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.736140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49f7a333-98ba-45d7-913d-ec715140df0d-istiod-ca-cert\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.737801 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.737777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-envoy\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.737906 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.737815 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49f7a333-98ba-45d7-913d-ec715140df0d-istio-podinfo\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.743033 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.742941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldbx6\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-kube-api-access-ldbx6\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.743139 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.743083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-istio-token\") pod \"e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.803611 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.803581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:04.936236 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.936201 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96"] Jul 06 22:54:04.938208 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:54:04.938175 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f7a333_98ba_45d7_913d_ec715140df0d.slice/crio-901e6f4ec8de97fed581e6ad510dff5e25fd15635a10a519c24fdb6a257487c6 WatchSource:0}: Error finding container 901e6f4ec8de97fed581e6ad510dff5e25fd15635a10a519c24fdb6a257487c6: Status 404 returned error can't find the container with id 901e6f4ec8de97fed581e6ad510dff5e25fd15635a10a519c24fdb6a257487c6 Jul 06 22:54:04.940814 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.940773 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:04.940893 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.940859 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:04.940933 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:04.940902 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:05.138274 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:05.138179 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" event={"ID":"49f7a333-98ba-45d7-913d-ec715140df0d","Type":"ContainerStarted","Data":"1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e"} Jul 06 22:54:05.138274 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:05.138245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" event={"ID":"49f7a333-98ba-45d7-913d-ec715140df0d","Type":"ContainerStarted","Data":"901e6f4ec8de97fed581e6ad510dff5e25fd15635a10a519c24fdb6a257487c6"} Jul 06 22:54:05.156096 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:05.156031 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" podStartSLOduration=1.156015726 podStartE2EDuration="1.156015726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:54:05.154994868 +0000 UTC m=+1595.670634471" watchObservedRunningTime="2026-07-06 22:54:05.156015726 +0000 UTC m=+1595.671655330" Jul 06 22:54:05.804071 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:05.804035 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:05.808656 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:05.808632 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:06.142505 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:06.142427 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:06.143434 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:06.143412 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:07.214200 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:07.214164 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:07.297969 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:07.297933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:07.370793 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:07.370764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:07.764645 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:07.764614 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:07.883882 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:07.883856 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:08.158443 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:08.158413 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:11.718259 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:11.718229 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:12.458322 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:12.458285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:12.538424 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:12.538395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:12.868179 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:12.868095 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:18.834129 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:18.834093 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:18.934628 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:18.934591 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:19.232244 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:19.232207 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:19.552460 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:19.552374 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:19.684680 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:19.684635 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:20.208013 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:20.207989 2577 generic.go:356] "Generic (PLEG): container finished" podID="49f7a333-98ba-45d7-913d-ec715140df0d" containerID="1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e" exitCode=0 Jul 06 22:54:20.208335 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:20.208024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" event={"ID":"49f7a333-98ba-45d7-913d-ec715140df0d","Type":"ContainerDied","Data":"1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e"} Jul 06 22:54:20.208470 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:20.208447 2577 scope.go:117] "RemoveContainer" containerID="1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e" Jul 06 22:54:20.209473 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:20.209443 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:20.209576 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:20.209529 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:20.209644 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:20.209588 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:21.142664 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:21.142622 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:21.214632 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:21.214597 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" event={"ID":"49f7a333-98ba-45d7-913d-ec715140df0d","Type":"ContainerStarted","Data":"626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81"} Jul 06 22:54:21.804169 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:21.804131 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:21.805074 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:21.805054 2577 patch_prober.go:28] interesting pod/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:54:21.805137 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:21.805103 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 06 22:54:22.803899 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:22.803862 2577 patch_prober.go:28] interesting pod/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:54:22.804343 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:22.803936 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 06 22:54:23.804353 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:23.804315 2577 patch_prober.go:28] interesting pod/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:54:23.804751 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:23.804377 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 06 22:54:24.804023 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:24.803981 2577 patch_prober.go:28] interesting pod/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 06 22:54:24.804202 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:24.804049 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 06 22:54:25.807609 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:25.807572 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:25.808032 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:25.807855 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:25.808570 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:25.808549 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:25.893201 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:25.893160 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:25.966741 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:25.966712 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:26.173963 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:26.173921 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96"] Jul 06 22:54:26.203543 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:26.203511 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:26.235336 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:26.235308 2577 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" secret="" err="secret \"e2e-mt-b80e969c-openshift-default-dockercfg-f45k5\" not found" Jul 06 22:54:26.455885 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:26.455811 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:26.575186 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:26.575153 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:26.675061 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:26.675007 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:26.801805 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:26.801723 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:27.239703 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:27.239663 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" containerID="cri-o://626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81" gracePeriod=30 Jul 06 22:54:32.494571 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.494546 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:32.575566 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575493 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-envoy\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.575566 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575543 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldbx6\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-kube-api-access-ldbx6\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.575566 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575563 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-istio-token\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.575852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575579 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-data\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.575852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575637 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-credential-socket\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.575852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575715 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49f7a333-98ba-45d7-913d-ec715140df0d-istio-podinfo\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.575852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575738 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49f7a333-98ba-45d7-913d-ec715140df0d-istiod-ca-cert\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.575852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575765 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-certs\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.575852 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575822 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-socket\") pod \"49f7a333-98ba-45d7-913d-ec715140df0d\" (UID: \"49f7a333-98ba-45d7-913d-ec715140df0d\") " Jul 06 22:54:32.576210 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.575898 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:32.576210 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.576153 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:32.576324 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.576223 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49f7a333-98ba-45d7-913d-ec715140df0d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:54:32.576324 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.576261 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:32.576429 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.576334 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:32.576429 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.576401 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-data" (OuterVolumeSpecName: "istio-data") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:32.577818 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.577789 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-istio-token" (OuterVolumeSpecName: "istio-token") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:54:32.577944 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.577894 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49f7a333-98ba-45d7-913d-ec715140df0d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:54:32.578083 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.578068 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:54:32.578152 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.578134 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-kube-api-access-ldbx6" (OuterVolumeSpecName: "kube-api-access-ldbx6") pod "49f7a333-98ba-45d7-913d-ec715140df0d" (UID: "49f7a333-98ba-45d7-913d-ec715140df0d"). InnerVolumeSpecName "kube-api-access-ldbx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:54:32.677125 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.677095 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:32.677125 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.677121 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:32.677306 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.677134 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49f7a333-98ba-45d7-913d-ec715140df0d-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:32.677306 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.677145 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49f7a333-98ba-45d7-913d-ec715140df0d-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:32.677306 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.677156 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:32.677306 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.677166 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:32.677306 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.677176 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49f7a333-98ba-45d7-913d-ec715140df0d-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:32.677306 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:32.677188 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldbx6\" (UniqueName: \"kubernetes.io/projected/49f7a333-98ba-45d7-913d-ec715140df0d-kube-api-access-ldbx6\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:54:33.272392 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.272357 2577 generic.go:356] "Generic (PLEG): container finished" podID="49f7a333-98ba-45d7-913d-ec715140df0d" containerID="626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81" exitCode=0 Jul 06 22:54:33.272558 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.272414 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" Jul 06 22:54:33.272558 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.272439 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" event={"ID":"49f7a333-98ba-45d7-913d-ec715140df0d","Type":"ContainerDied","Data":"626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81"} Jul 06 22:54:33.272558 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.272516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96" event={"ID":"49f7a333-98ba-45d7-913d-ec715140df0d","Type":"ContainerDied","Data":"901e6f4ec8de97fed581e6ad510dff5e25fd15635a10a519c24fdb6a257487c6"} Jul 06 22:54:33.272558 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.272538 2577 scope.go:117] "RemoveContainer" containerID="626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81" Jul 06 22:54:33.281344 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.281303 2577 scope.go:117] "RemoveContainer" containerID="1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e" Jul 06 22:54:33.288616 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.288598 2577 scope.go:117] "RemoveContainer" containerID="626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81" Jul 06 22:54:33.288850 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:54:33.288832 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81\": container with ID starting with 626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81 not found: ID does not exist" containerID="626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81" Jul 06 22:54:33.288889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.288863 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81"} err="failed to get container status \"626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81\": rpc error: code = NotFound desc = could not find container \"626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81\": container with ID starting with 626bb2c377fd5213f81cb8e98abf430a1e49d0b3ef39b5702aa38d930e5f4c81 not found: ID does not exist" Jul 06 22:54:33.288889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.288879 2577 scope.go:117] "RemoveContainer" containerID="1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e" Jul 06 22:54:33.289120 ip-10-0-132-3 kubenswrapper[2577]: E0706 22:54:33.289102 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e\": container with ID starting with 1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e not found: ID does not exist" containerID="1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e" Jul 06 22:54:33.289166 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.289125 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e"} err="failed to get container status \"1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e\": rpc error: code = NotFound desc = could not find container \"1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e\": container with ID starting with 1768e99d649dcf1963ba4c988bd79258b3cef9a6f0c021a17fcdfd65671dbe7e not found: ID does not exist" Jul 06 22:54:33.296306 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.296286 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96"] Jul 06 22:54:33.303744 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.303723 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b80e969c-openshift-default-765f5fcbdc-sgx96"] Jul 06 22:54:33.347021 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.347000 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:33.450978 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.450940 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:33.551208 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.551143 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:33.806566 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:33.806492 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:35.021225 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:35.021195 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" path="/var/lib/kubelet/pods/49f7a333-98ba-45d7-913d-ec715140df0d/volumes" Jul 06 22:54:40.075446 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:40.075413 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:40.179513 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:40.179486 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:46.976515 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:46.976451 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:47.294822 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.294738 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9"] Jul 06 22:54:47.295140 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.295124 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" Jul 06 22:54:47.295140 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.295141 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" Jul 06 22:54:47.295238 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.295153 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" Jul 06 22:54:47.295238 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.295159 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" Jul 06 22:54:47.295238 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.295223 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" Jul 06 22:54:47.299618 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.299602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.302714 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.302681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2513e2ce-openshift-default-dockercfg-phk5n\"" Jul 06 22:54:47.318190 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.318156 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9"] Jul 06 22:54:47.345402 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.345377 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:47.395374 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-podinfo\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.395503 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4wzz\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-kube-api-access-x4wzz\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.395503 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-envoy\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.395503 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istiod-ca-cert\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.395656 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-credential-socket\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.395656 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-token\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.395656 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-certs\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.395773 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-data\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.395773 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.395683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-socket\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.438889 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.438867 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:47.496573 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4wzz\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-kube-api-access-x4wzz\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.496753 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-envoy\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.496753 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istiod-ca-cert\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.496753 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-credential-socket\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.496753 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-token\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497222 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-certs\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497222 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-data\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497222 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-socket\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497222 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.496933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-podinfo\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497222 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.497140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-credential-socket\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497490 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.497260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-data\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497490 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.497340 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-socket\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497490 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.497349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-certs\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.497672 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.497657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istiod-ca-cert\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.498870 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.498838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-envoy\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.499244 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.499223 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-podinfo\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.507865 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.507845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-token\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.508022 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.508000 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4wzz\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-kube-api-access-x4wzz\") pod \"e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.613435 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.613380 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:47.745673 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.745649 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9"] Jul 06 22:54:47.747480 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:54:47.747455 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246f178a_a36d_4226_bb7a_d3f01d2e3d48.slice/crio-d22d3e4c2e7d7c13d17254f676198f2fdc385773d57ca7fac3f6259a7967463f WatchSource:0}: Error finding container d22d3e4c2e7d7c13d17254f676198f2fdc385773d57ca7fac3f6259a7967463f: Status 404 returned error can't find the container with id d22d3e4c2e7d7c13d17254f676198f2fdc385773d57ca7fac3f6259a7967463f Jul 06 22:54:47.749427 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.749385 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:47.749533 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.749460 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:47.749533 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:47.749502 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:54:48.341142 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:48.341111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" event={"ID":"246f178a-a36d-4226-bb7a-d3f01d2e3d48","Type":"ContainerStarted","Data":"943414d155d58519d1a1f98c31bea4ee1db6bf83aab5fdd187e2f281da69c5af"} Jul 06 22:54:48.341514 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:48.341161 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" event={"ID":"246f178a-a36d-4226-bb7a-d3f01d2e3d48","Type":"ContainerStarted","Data":"d22d3e4c2e7d7c13d17254f676198f2fdc385773d57ca7fac3f6259a7967463f"} Jul 06 22:54:48.367007 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:48.366946 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" podStartSLOduration=1.3669310399999999 podStartE2EDuration="1.36693104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:54:48.364656079 +0000 UTC m=+1638.880295683" watchObservedRunningTime="2026-07-06 22:54:48.36693104 +0000 UTC m=+1638.882570644" Jul 06 22:54:48.614292 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:48.614219 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:48.618781 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:48.618758 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:49.345829 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:49.345787 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:49.346522 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:49.346506 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:54:50.361597 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:50.361563 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:50.504686 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:50.504655 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:50.703586 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:50.703552 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:50.827342 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:50.827312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:51.540796 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:51.540760 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:51.784426 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:51.784396 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:54.861458 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:54.861427 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:57.472247 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:57.472217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:54:57.592132 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:54:57.592102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:01.888196 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:01.888168 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:04.981076 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:04.981039 2577 patch_prober.go:28] interesting pod/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": read tcp 10.133.0.2:33642->10.133.0.38:15021: read: connection reset by peer" start-of-body= Jul 06 22:55:04.981536 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:04.981110 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": read tcp 10.133.0.2:33642->10.133.0.38:15021: read: connection reset by peer" Jul 06 22:55:05.419792 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:05.419759 2577 generic.go:356] "Generic (PLEG): container finished" podID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerID="943414d155d58519d1a1f98c31bea4ee1db6bf83aab5fdd187e2f281da69c5af" exitCode=0 Jul 06 22:55:05.419973 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:05.419829 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" event={"ID":"246f178a-a36d-4226-bb7a-d3f01d2e3d48","Type":"ContainerDied","Data":"943414d155d58519d1a1f98c31bea4ee1db6bf83aab5fdd187e2f281da69c5af"} Jul 06 22:55:05.420200 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:05.420187 2577 scope.go:117] "RemoveContainer" containerID="943414d155d58519d1a1f98c31bea4ee1db6bf83aab5fdd187e2f281da69c5af" Jul 06 22:55:05.421126 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:05.421100 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:55:05.421184 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:05.421166 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:55:05.421220 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:05.421196 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:55:06.093504 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:06.093456 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:06.193425 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:06.193396 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:06.425690 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:06.425659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" event={"ID":"246f178a-a36d-4226-bb7a-d3f01d2e3d48","Type":"ContainerStarted","Data":"18aec7cfa58d5e21fac70c2877fd2c3cb8bf2a297b4a270a525a306958148970"} Jul 06 22:55:06.613697 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:06.613663 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:55:06.613934 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:06.613907 2577 patch_prober.go:28] interesting pod/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 06 22:55:06.614017 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:06.613993 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 06 22:55:07.613936 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:07.613899 2577 patch_prober.go:28] interesting pod/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 06 22:55:07.614344 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:07.613992 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 06 22:55:08.614641 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:08.614602 2577 patch_prober.go:28] interesting pod/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 06 22:55:08.615039 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:08.614651 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 06 22:55:09.614358 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:09.614323 2577 patch_prober.go:28] interesting pod/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 06 22:55:09.614548 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:09.614381 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 06 22:55:10.617064 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:10.617035 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:55:10.617459 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:10.617361 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:55:10.617939 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:10.617922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:55:13.126188 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:13.126161 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:15.031113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:15.031031 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:32.433157 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:32.433108 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:32.802163 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:32.802059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:38.567610 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:38.567581 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:55:43.599354 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:55:43.599320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:19.789380 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:19.789348 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:20.620599 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:20.620562 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:26.553690 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:26.553655 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:32.471044 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:32.471008 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:32.571437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:32.571405 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:32.695902 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:32.695875 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9"] Jul 06 22:56:32.696122 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:32.696090 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" containerID="cri-o://18aec7cfa58d5e21fac70c2877fd2c3cb8bf2a297b4a270a525a306958148970" gracePeriod=30 Jul 06 22:56:32.710734 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:32.710708 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:32.953495 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:32.953467 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:34.011491 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:34.011448 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:34.120447 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:34.120408 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:34.246698 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:34.246661 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:34.944542 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:34.944506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:35.043141 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:35.043107 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:35.143551 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:35.143520 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:36.510071 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:36.510045 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:37.840777 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:37.840739 2577 generic.go:356] "Generic (PLEG): container finished" podID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerID="18aec7cfa58d5e21fac70c2877fd2c3cb8bf2a297b4a270a525a306958148970" exitCode=0 Jul 06 22:56:37.841227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:37.840811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" event={"ID":"246f178a-a36d-4226-bb7a-d3f01d2e3d48","Type":"ContainerDied","Data":"18aec7cfa58d5e21fac70c2877fd2c3cb8bf2a297b4a270a525a306958148970"} Jul 06 22:56:37.841227 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:37.840891 2577 scope.go:117] "RemoveContainer" containerID="943414d155d58519d1a1f98c31bea4ee1db6bf83aab5fdd187e2f281da69c5af" Jul 06 22:56:37.949930 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:37.949903 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:56:38.018742 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018671 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-token\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.018742 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018711 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4wzz\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-kube-api-access-x4wzz\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.018974 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018758 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istiod-ca-cert\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.018974 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018814 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-envoy\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.018974 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018839 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-credential-socket\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.018974 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018862 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-socket\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.018974 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018888 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-podinfo\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.018974 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018913 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-certs\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.019358 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.018983 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-data\") pod \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\" (UID: \"246f178a-a36d-4226-bb7a-d3f01d2e3d48\") " Jul 06 22:56:38.019358 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.019105 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:38.019358 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.019194 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 22:56:38.019358 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.019287 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.019358 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.019300 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.019620 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.019560 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:38.019620 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.019574 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:38.020602 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.020564 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-data" (OuterVolumeSpecName: "istio-data") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:38.021450 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.021403 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-token" (OuterVolumeSpecName: "istio-token") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:38.021450 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.021439 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-kube-api-access-x4wzz" (OuterVolumeSpecName: "kube-api-access-x4wzz") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "kube-api-access-x4wzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 22:56:38.021598 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.021482 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 22:56:38.021598 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.021540 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "246f178a-a36d-4226-bb7a-d3f01d2e3d48" (UID: "246f178a-a36d-4226-bb7a-d3f01d2e3d48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 22:56:38.120321 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.120289 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.120321 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.120320 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.120477 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.120333 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.120477 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.120346 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.120477 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.120370 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.120477 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.120383 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.120477 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.120396 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4wzz\" (UniqueName: \"kubernetes.io/projected/246f178a-a36d-4226-bb7a-d3f01d2e3d48-kube-api-access-x4wzz\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 22:56:38.846017 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.845986 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" Jul 06 22:56:38.846513 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.846018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9" event={"ID":"246f178a-a36d-4226-bb7a-d3f01d2e3d48","Type":"ContainerDied","Data":"d22d3e4c2e7d7c13d17254f676198f2fdc385773d57ca7fac3f6259a7967463f"} Jul 06 22:56:38.846513 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.846073 2577 scope.go:117] "RemoveContainer" containerID="18aec7cfa58d5e21fac70c2877fd2c3cb8bf2a297b4a270a525a306958148970" Jul 06 22:56:38.867300 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.867070 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9"] Jul 06 22:56:38.868963 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:38.868933 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2513e2ce-openshift-default-6dc7cfbcff-ktlk9"] Jul 06 22:56:39.021007 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:39.020979 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" path="/var/lib/kubelet/pods/246f178a-a36d-4226-bb7a-d3f01d2e3d48/volumes" Jul 06 22:56:42.381107 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:42.381074 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:42.481166 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:42.481121 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:43.050438 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:43.050394 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:48.831059 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:48.831012 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:48.886175 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:48.886114 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:48.958871 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:48.958835 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:49.058997 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:49.058963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:59.532209 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:59.532174 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:56:59.902137 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:56:59.902054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:20.850614 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:20.850579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:26.766059 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:26.765928 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:26.866116 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:26.866087 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:27.126855 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.126780 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:27.421179 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.421148 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p"] Jul 06 22:57:27.421507 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.421494 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" Jul 06 22:57:27.421561 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.421508 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" Jul 06 22:57:27.421561 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.421525 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" Jul 06 22:57:27.421561 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.421533 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" Jul 06 22:57:27.421656 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.421600 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49f7a333-98ba-45d7-913d-ec715140df0d" containerName="istio-proxy" Jul 06 22:57:27.421656 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.421614 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" Jul 06 22:57:27.421656 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.421622 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="246f178a-a36d-4226-bb7a-d3f01d2e3d48" containerName="istio-proxy" Jul 06 22:57:27.424599 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.424583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.426806 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.426787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6d2b52-openshift-default-dockercfg-d2wxz\"" Jul 06 22:57:27.437932 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.437910 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p"] Jul 06 22:57:27.443424 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.443401 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:27.527619 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.527583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-envoy\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.527793 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.527739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-socket\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.527793 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.527779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-data\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.527899 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.527815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d677b15-5485-4d8e-b914-91849bb19e35-istiod-ca-cert\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.527899 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.527868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stq7q\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-kube-api-access-stq7q\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.528006 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.527907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-credential-socket\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.528006 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.527933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-istio-token\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.528006 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.527996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d677b15-5485-4d8e-b914-91849bb19e35-istio-podinfo\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.528133 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.528025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-certs\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.597882 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.597850 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:27.628916 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.628892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-socket\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629073 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.628927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-data\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629073 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.628971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d677b15-5485-4d8e-b914-91849bb19e35-istiod-ca-cert\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629073 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stq7q\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-kube-api-access-stq7q\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629073 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-credential-socket\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629073 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-istio-token\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629073 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d677b15-5485-4d8e-b914-91849bb19e35-istio-podinfo\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629373 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-certs\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629373 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-envoy\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629373 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629341 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-socket\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629566 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-data\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629640 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629625 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-credential-socket\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629767 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-certs\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.629869 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.629848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d677b15-5485-4d8e-b914-91849bb19e35-istiod-ca-cert\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.631193 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.631174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-envoy\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.631489 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.631471 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d677b15-5485-4d8e-b914-91849bb19e35-istio-podinfo\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.636576 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.636544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-istio-token\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.636841 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.636823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stq7q\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-kube-api-access-stq7q\") pod \"e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.734818 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.734740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:27.869687 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.869659 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p"] Jul 06 22:57:27.871337 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:57:27.871309 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d677b15_5485_4d8e_b914_91849bb19e35.slice/crio-5f60c5f4a278e550b3c18ed5a47c80e8a990aff9f4b87e8e550db5dd9dca7170 WatchSource:0}: Error finding container 5f60c5f4a278e550b3c18ed5a47c80e8a990aff9f4b87e8e550db5dd9dca7170: Status 404 returned error can't find the container with id 5f60c5f4a278e550b3c18ed5a47c80e8a990aff9f4b87e8e550db5dd9dca7170 Jul 06 22:57:27.873331 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.873294 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:27.873437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.873358 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:27.873437 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:27.873387 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:28.065875 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:28.065783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" event={"ID":"6d677b15-5485-4d8e-b914-91849bb19e35","Type":"ContainerStarted","Data":"8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3"} Jul 06 22:57:28.065875 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:28.065846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" event={"ID":"6d677b15-5485-4d8e-b914-91849bb19e35","Type":"ContainerStarted","Data":"5f60c5f4a278e550b3c18ed5a47c80e8a990aff9f4b87e8e550db5dd9dca7170"} Jul 06 22:57:28.087593 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:28.087544 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" podStartSLOduration=1.087530565 podStartE2EDuration="1.087530565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:57:28.086385682 +0000 UTC m=+1798.602025287" watchObservedRunningTime="2026-07-06 22:57:28.087530565 +0000 UTC m=+1798.603170169" Jul 06 22:57:28.735019 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:28.734988 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:28.739993 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:28.739972 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:29.069880 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:29.069788 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:29.070843 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:29.070826 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:29.981770 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:29.981742 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:57:29.982108 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:29.982092 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 22:57:30.006761 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:30.006729 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:30.106294 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:30.106271 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:30.229640 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:30.229604 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:30.327813 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:30.327734 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:30.674607 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:30.674578 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:30.775392 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:30.775359 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:34.511594 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:34.511560 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:34.858296 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:34.858211 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:35.134645 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.134559 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4"] Jul 06 22:57:35.137972 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.137942 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.140192 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.140166 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-63da37-openshift-default-dockercfg-lc2p2\"" Jul 06 22:57:35.148760 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.148737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4"] Jul 06 22:57:35.159568 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.159538 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:35.196808 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.196779 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-token\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.196928 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.196822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-credential-socket\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.196928 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.196844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-certs\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.196928 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.196883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-data\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.197135 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.196937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-envoy\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.197135 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.197011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-podinfo\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.197135 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.197033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-socket\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.197135 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.197048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istiod-ca-cert\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.197135 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.197063 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvhht\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-kube-api-access-dvhht\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298594 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-token\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-credential-socket\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-certs\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-data\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-envoy\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-podinfo\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-socket\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298778 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istiod-ca-cert\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.298854 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.298801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvhht\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-kube-api-access-dvhht\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.299298 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.299144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-certs\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.299298 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.299215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-credential-socket\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.299391 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.299345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-data\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.299485 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.299454 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-socket\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.299805 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.299779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istiod-ca-cert\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.301680 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.301656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-envoy\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.301824 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.301804 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-podinfo\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.309427 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.309408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-token\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.309669 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.309650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvhht\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-kube-api-access-dvhht\") pod \"e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.336559 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.336532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:35.449135 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.449105 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:35.578457 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.578434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4"] Jul 06 22:57:35.580854 ip-10-0-132-3 kubenswrapper[2577]: W0706 22:57:35.580826 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eee9890_a6e2_4cf7_8a52_4837e2106f7d.slice/crio-41c6c033070b2a7d400caeffc84a68c432daa801f4f08216d6956bd8025f74da WatchSource:0}: Error finding container 41c6c033070b2a7d400caeffc84a68c432daa801f4f08216d6956bd8025f74da: Status 404 returned error can't find the container with id 41c6c033070b2a7d400caeffc84a68c432daa801f4f08216d6956bd8025f74da Jul 06 22:57:35.583170 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.583140 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:35.583238 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.583208 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:35.583238 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:35.583235 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:36.103769 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:36.103735 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" event={"ID":"4eee9890-a6e2-4cf7-8a52-4837e2106f7d","Type":"ContainerStarted","Data":"4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e"} Jul 06 22:57:36.103971 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:36.103784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" event={"ID":"4eee9890-a6e2-4cf7-8a52-4837e2106f7d","Type":"ContainerStarted","Data":"41c6c033070b2a7d400caeffc84a68c432daa801f4f08216d6956bd8025f74da"} Jul 06 22:57:36.125413 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:36.125356 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" podStartSLOduration=1.125336598 podStartE2EDuration="1.125336598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:57:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:57:36.122332503 +0000 UTC m=+1806.637972110" watchObservedRunningTime="2026-07-06 22:57:36.125336598 +0000 UTC m=+1806.640976207" Jul 06 22:57:36.449405 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:36.449365 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:36.455460 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:36.455422 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:37.108345 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:37.108306 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:37.109195 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:37.109175 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:38.008105 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:38.008071 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:38.090319 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:38.090283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:38.163468 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:38.163396 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:38.268845 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:38.268761 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:38.565455 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:38.565359 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:38.665975 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:38.665909 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:42.512392 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:42.512356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:44.071581 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:44.071547 2577 patch_prober.go:28] interesting pod/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:57:44.072039 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:44.071613 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 06 22:57:44.142422 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:44.142385 2577 generic.go:356] "Generic (PLEG): container finished" podID="6d677b15-5485-4d8e-b914-91849bb19e35" containerID="8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3" exitCode=0 Jul 06 22:57:44.142597 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:44.142500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" event={"ID":"6d677b15-5485-4d8e-b914-91849bb19e35","Type":"ContainerDied","Data":"8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3"} Jul 06 22:57:44.143028 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:44.142994 2577 scope.go:117] "RemoveContainer" containerID="8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3" Jul 06 22:57:44.144438 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:44.144394 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:44.144542 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:44.144489 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:44.144606 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:44.144545 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:45.152562 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:45.152515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" event={"ID":"6d677b15-5485-4d8e-b914-91849bb19e35","Type":"ContainerStarted","Data":"91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869"} Jul 06 22:57:45.734909 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:45.734873 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:45.735113 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:45.735074 2577 patch_prober.go:28] interesting pod/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:57:45.735165 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:45.735130 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 06 22:57:46.735734 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:46.735694 2577 patch_prober.go:28] interesting pod/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:57:46.736236 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:46.735756 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 06 22:57:47.735112 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:47.735074 2577 patch_prober.go:28] interesting pod/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:57:47.735311 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:47.735147 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 06 22:57:48.735883 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:48.735849 2577 patch_prober.go:28] interesting pod/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 06 22:57:48.736278 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:48.735903 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 06 22:57:49.739046 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:49.739021 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:49.739428 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:49.739292 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:49.739938 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:49.739921 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 22:57:50.181579 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:50.181540 2577 generic.go:356] "Generic (PLEG): container finished" podID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerID="4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e" exitCode=0 Jul 06 22:57:50.181751 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:50.181612 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" event={"ID":"4eee9890-a6e2-4cf7-8a52-4837e2106f7d","Type":"ContainerDied","Data":"4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e"} Jul 06 22:57:50.182149 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:50.182133 2577 scope.go:117] "RemoveContainer" containerID="4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e" Jul 06 22:57:50.183146 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:50.183120 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:50.183218 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:50.183204 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:50.183259 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:50.183248 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 22:57:51.187628 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:51.187590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" event={"ID":"4eee9890-a6e2-4cf7-8a52-4837e2106f7d","Type":"ContainerStarted","Data":"1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa"} Jul 06 22:57:51.450035 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:51.449922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:51.451389 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:51.451351 2577 patch_prober.go:28] interesting pod/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:57:51.451531 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:51.451428 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 06 22:57:51.715630 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:51.715548 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:51.816881 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:51.816848 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:57:52.108686 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:52.108608 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:52.450245 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:52.450209 2577 patch_prober.go:28] interesting pod/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:57:52.450837 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:52.450804 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 06 22:57:53.450028 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:53.449991 2577 patch_prober.go:28] interesting pod/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:57:53.450305 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:53.450276 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 06 22:57:54.449593 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:54.449542 2577 patch_prober.go:28] interesting pod/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 06 22:57:54.449894 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:54.449865 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 06 22:57:55.453385 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:55.453353 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:57:55.454276 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:57:55.454257 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 22:58:00.231034 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:58:00.230999 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:00.332079 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:58:00.332047 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:13.117360 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:58:13.117328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:58:39.144601 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:58:39.144564 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:22.131727 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:22.131677 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:23.291633 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:23.291603 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:23.479586 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:23.479554 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:23.875540 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:23.875509 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:23.975931 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:23.975901 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:24.075391 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:24.075359 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:24.220259 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:24.220228 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:28.946178 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:28.946143 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 22:59:35.648240 ip-10-0-132-3 kubenswrapper[2577]: I0706 22:59:35.648198 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:05.752708 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:05.752668 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:06.069073 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:06.068978 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p"] Jul 06 23:00:06.069227 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:06.069178 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" containerID="cri-o://91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869" gracePeriod=30 Jul 06 23:00:06.079245 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:06.079220 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:06.282117 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:06.282083 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:06.448887 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:06.448852 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:06.860025 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:06.859912 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:06.965898 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:06.965864 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:07.157752 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:07.157716 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:11.322488 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.322464 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 23:00:11.457934 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.457901 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-istio-token\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.457934 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.457938 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d677b15-5485-4d8e-b914-91849bb19e35-istio-podinfo\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.458213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.457999 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stq7q\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-kube-api-access-stq7q\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.458213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458023 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d677b15-5485-4d8e-b914-91849bb19e35-istiod-ca-cert\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.458213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458048 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-certs\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.458213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458142 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-envoy\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.458213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458165 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-credential-socket\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.458213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458187 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-socket\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.458213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458208 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-data\") pod \"6d677b15-5485-4d8e-b914-91849bb19e35\" (UID: \"6d677b15-5485-4d8e-b914-91849bb19e35\") " Jul 06 23:00:11.458580 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458409 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:11.458580 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458501 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.458580 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458525 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:11.458726 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458582 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d677b15-5485-4d8e-b914-91849bb19e35-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:00:11.458726 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.458605 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:11.459201 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.459184 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:11.460627 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.460606 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:11.460725 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.460623 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-kube-api-access-stq7q" (OuterVolumeSpecName: "kube-api-access-stq7q") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "kube-api-access-stq7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:11.460725 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.460674 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:11.460725 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.460700 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d677b15-5485-4d8e-b914-91849bb19e35-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d677b15-5485-4d8e-b914-91849bb19e35" (UID: "6d677b15-5485-4d8e-b914-91849bb19e35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:00:11.559001 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.558965 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.559001 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.558996 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.559001 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.559006 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.559229 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.559015 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d677b15-5485-4d8e-b914-91849bb19e35-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.559229 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.559023 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.559229 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.559030 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d677b15-5485-4d8e-b914-91849bb19e35-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.559229 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.559038 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stq7q\" (UniqueName: \"kubernetes.io/projected/6d677b15-5485-4d8e-b914-91849bb19e35-kube-api-access-stq7q\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.559229 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.559048 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d677b15-5485-4d8e-b914-91849bb19e35-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:11.815118 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.815032 2577 generic.go:356] "Generic (PLEG): container finished" podID="6d677b15-5485-4d8e-b914-91849bb19e35" containerID="91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869" exitCode=0 Jul 06 23:00:11.815118 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.815089 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" Jul 06 23:00:11.815118 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.815095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" event={"ID":"6d677b15-5485-4d8e-b914-91849bb19e35","Type":"ContainerDied","Data":"91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869"} Jul 06 23:00:11.815345 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.815150 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p" event={"ID":"6d677b15-5485-4d8e-b914-91849bb19e35","Type":"ContainerDied","Data":"5f60c5f4a278e550b3c18ed5a47c80e8a990aff9f4b87e8e550db5dd9dca7170"} Jul 06 23:00:11.815345 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.815183 2577 scope.go:117] "RemoveContainer" containerID="91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869" Jul 06 23:00:11.824182 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.824157 2577 scope.go:117] "RemoveContainer" containerID="8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3" Jul 06 23:00:11.832118 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.832099 2577 scope.go:117] "RemoveContainer" containerID="91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869" Jul 06 23:00:11.832358 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:00:11.832337 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869\": container with ID starting with 91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869 not found: ID does not exist" containerID="91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869" Jul 06 23:00:11.832402 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.832366 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869"} err="failed to get container status \"91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869\": rpc error: code = NotFound desc = could not find container \"91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869\": container with ID starting with 91d8d1f760ba479511b754d494df8fbba5f11d467890803c7524f2ae5d034869 not found: ID does not exist" Jul 06 23:00:11.832402 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.832387 2577 scope.go:117] "RemoveContainer" containerID="8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3" Jul 06 23:00:11.832592 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:00:11.832577 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3\": container with ID starting with 8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3 not found: ID does not exist" containerID="8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3" Jul 06 23:00:11.832631 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.832596 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3"} err="failed to get container status \"8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3\": rpc error: code = NotFound desc = could not find container \"8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3\": container with ID starting with 8618394cb01e42ddf4da1093af511264e6c432c6215fc9ffa493f9d01155fac3 not found: ID does not exist" Jul 06 23:00:11.835609 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.835587 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p"] Jul 06 23:00:11.839078 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:11.839059 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6d2b52-openshift-default-74bb7d7f95-lps6p"] Jul 06 23:00:12.778663 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:12.778624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:12.879129 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:12.879090 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:13.022417 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.022385 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" path="/var/lib/kubelet/pods/6d677b15-5485-4d8e-b914-91849bb19e35/volumes" Jul 06 23:00:13.022673 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.022659 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4"] Jul 06 23:00:13.022866 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.022845 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" containerID="cri-o://1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa" gracePeriod=30 Jul 06 23:00:13.041739 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.041668 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:13.271398 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.271363 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:13.609499 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.609466 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:13.916852 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.916822 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c"] Jul 06 23:00:13.917232 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.917215 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" Jul 06 23:00:13.917232 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.917227 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" Jul 06 23:00:13.917307 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.917302 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" Jul 06 23:00:13.917340 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.917311 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" Jul 06 23:00:13.921853 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.921833 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:13.924054 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.924037 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4a6cf6-openshift-default-dockercfg-x2qvr\"" Jul 06 23:00:13.930763 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.930741 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c"] Jul 06 23:00:13.943662 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:13.943634 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:14.082704 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-certs\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.082704 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-token\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.082925 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istiod-ca-cert\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.082925 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-envoy\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.082925 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-socket\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.082925 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qv8d\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-kube-api-access-9qv8d\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.082925 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-podinfo\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.082925 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-credential-socket\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.082925 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.082869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-data\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.183915 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.183831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-certs\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.183915 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.183877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-token\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184158 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.183916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istiod-ca-cert\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184158 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.183977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-envoy\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184158 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-socket\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184314 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184173 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv8d\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-kube-api-access-9qv8d\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184314 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-podinfo\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184314 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-credential-socket\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184314 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-data\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184518 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-certs\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184518 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-socket\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184647 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-data\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184647 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-credential-socket\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.184755 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.184728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istiod-ca-cert\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.186224 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.186204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-envoy\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.186624 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.186604 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-podinfo\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.192104 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.192080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-token\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.192192 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.192177 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qv8d\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-kube-api-access-9qv8d\") pod \"e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.204737 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.204713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:14.232795 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.232776 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:14.375167 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.375137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c"] Jul 06 23:00:14.377038 ip-10-0-132-3 kubenswrapper[2577]: W0706 23:00:14.377005 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10bf2e9_3188_49dd_a65f_2bb6d0c906e4.slice/crio-a7c13b22ad428449c2df3656635b4aa56f0dd57ceb99626f103b32f4e610af91 WatchSource:0}: Error finding container a7c13b22ad428449c2df3656635b4aa56f0dd57ceb99626f103b32f4e610af91: Status 404 returned error can't find the container with id a7c13b22ad428449c2df3656635b4aa56f0dd57ceb99626f103b32f4e610af91 Jul 06 23:00:14.379222 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.379186 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:14.379334 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.379263 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:14.379334 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.379306 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:14.833580 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.833536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" event={"ID":"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4","Type":"ContainerStarted","Data":"d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e"} Jul 06 23:00:14.833757 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.833595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" event={"ID":"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4","Type":"ContainerStarted","Data":"a7c13b22ad428449c2df3656635b4aa56f0dd57ceb99626f103b32f4e610af91"} Jul 06 23:00:14.853545 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:14.853496 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" podStartSLOduration=1.8534790490000002 podStartE2EDuration="1.853479049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:14.851651072 +0000 UTC m=+1965.367290679" watchObservedRunningTime="2026-07-06 23:00:14.853479049 +0000 UTC m=+1965.369118652" Jul 06 23:00:15.233801 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:15.233772 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:15.238860 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:15.238833 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:15.838231 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:15.838197 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:15.839070 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:15.839046 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:16.743818 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:16.743778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:18.278766 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.278742 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 23:00:18.426055 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426028 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-token\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426207 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426067 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-certs\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426207 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426106 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-envoy\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426207 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426122 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-socket\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426207 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426138 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvhht\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-kube-api-access-dvhht\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426207 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426155 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-podinfo\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426207 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426186 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-data\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426207 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426204 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istiod-ca-cert\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426572 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426235 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-credential-socket\") pod \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\" (UID: \"4eee9890-a6e2-4cf7-8a52-4837e2106f7d\") " Jul 06 23:00:18.426572 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426298 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:18.426688 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426579 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.426788 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426769 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:18.426901 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.426863 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:18.427123 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.427083 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:18.427262 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.427217 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:00:18.428314 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.428294 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:18.428666 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.428644 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:18.428753 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.428658 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:00:18.428795 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.428762 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-kube-api-access-dvhht" (OuterVolumeSpecName: "kube-api-access-dvhht") pod "4eee9890-a6e2-4cf7-8a52-4837e2106f7d" (UID: "4eee9890-a6e2-4cf7-8a52-4837e2106f7d"). InnerVolumeSpecName "kube-api-access-dvhht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:18.527269 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.527244 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.527269 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.527267 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.527414 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.527276 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvhht\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-kube-api-access-dvhht\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.527414 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.527285 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.527414 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.527293 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.527414 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.527301 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.527414 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.527308 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.527414 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.527315 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4eee9890-a6e2-4cf7-8a52-4837e2106f7d-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:18.853175 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.853088 2577 generic.go:356] "Generic (PLEG): container finished" podID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerID="1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa" exitCode=0 Jul 06 23:00:18.853175 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.853135 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" Jul 06 23:00:18.853350 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.853179 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" event={"ID":"4eee9890-a6e2-4cf7-8a52-4837e2106f7d","Type":"ContainerDied","Data":"1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa"} Jul 06 23:00:18.853350 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.853238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4" event={"ID":"4eee9890-a6e2-4cf7-8a52-4837e2106f7d","Type":"ContainerDied","Data":"41c6c033070b2a7d400caeffc84a68c432daa801f4f08216d6956bd8025f74da"} Jul 06 23:00:18.853350 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.853265 2577 scope.go:117] "RemoveContainer" containerID="1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa" Jul 06 23:00:18.863905 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.863890 2577 scope.go:117] "RemoveContainer" containerID="4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e" Jul 06 23:00:18.872073 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.871932 2577 scope.go:117] "RemoveContainer" containerID="1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa" Jul 06 23:00:18.872245 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:00:18.872226 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa\": container with ID starting with 1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa not found: ID does not exist" containerID="1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa" Jul 06 23:00:18.872306 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.872252 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa"} err="failed to get container status \"1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa\": rpc error: code = NotFound desc = could not find container \"1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa\": container with ID starting with 1d7330729f6af5bde7557ece2024a0ff911bffae6ad80cf9317260995986d5fa not found: ID does not exist" Jul 06 23:00:18.872306 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.872269 2577 scope.go:117] "RemoveContainer" containerID="4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e" Jul 06 23:00:18.872536 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:00:18.872517 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e\": container with ID starting with 4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e not found: ID does not exist" containerID="4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e" Jul 06 23:00:18.872584 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.872545 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e"} err="failed to get container status \"4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e\": rpc error: code = NotFound desc = could not find container \"4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e\": container with ID starting with 4ce438602238e7344040621bebeea986af3d3137b244dd2922cf6fb1c7fc4b9e not found: ID does not exist" Jul 06 23:00:18.873699 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.873680 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4"] Jul 06 23:00:18.877131 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:18.877112 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-63da37-openshift-default-7446c8cdc9-7fqr4"] Jul 06 23:00:19.022162 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:19.022133 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" path="/var/lib/kubelet/pods/4eee9890-a6e2-4cf7-8a52-4837e2106f7d/volumes" Jul 06 23:00:20.155999 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:20.155947 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:21.272711 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:21.272675 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:21.786565 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:21.786534 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:22.060921 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.060835 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5"] Jul 06 23:00:22.061235 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.061221 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" Jul 06 23:00:22.061304 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.061236 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d677b15-5485-4d8e-b914-91849bb19e35" containerName="istio-proxy" Jul 06 23:00:22.061304 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.061253 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" Jul 06 23:00:22.061304 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.061258 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" Jul 06 23:00:22.061304 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.061271 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" Jul 06 23:00:22.061304 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.061280 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" Jul 06 23:00:22.061553 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.061340 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" Jul 06 23:00:22.061553 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.061350 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eee9890-a6e2-4cf7-8a52-4837e2106f7d" containerName="istio-proxy" Jul 06 23:00:22.065795 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.065773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.068218 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.068202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-280980-openshift-default-dockercfg-nwxzl\"" Jul 06 23:00:22.075405 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.075378 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5"] Jul 06 23:00:22.093821 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.093781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:22.184495 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.184465 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:22.257713 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.257675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-credential-socket\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.257899 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.257722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-data\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.257899 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.257786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d03f90-a07f-414c-acff-92dbad4b8468-istio-podinfo\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.257899 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.257827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d03f90-a07f-414c-acff-92dbad4b8468-istiod-ca-cert\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.257899 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.257869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-socket\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.257899 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.257890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-envoy\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.258155 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.257966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-certs\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.258155 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.257989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-istio-token\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.258155 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.258010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwx4c\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-kube-api-access-dwx4c\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.358702 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d03f90-a07f-414c-acff-92dbad4b8468-istio-podinfo\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.358702 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d03f90-a07f-414c-acff-92dbad4b8468-istiod-ca-cert\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.358702 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-socket\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.358702 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-envoy\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-certs\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-istio-token\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwx4c\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-kube-api-access-dwx4c\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-credential-socket\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.358861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-data\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.359345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-socket\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359602 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.359412 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-credential-socket\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359602 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.359476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-certs\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359602 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.359559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-data\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.359736 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.359722 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d03f90-a07f-414c-acff-92dbad4b8468-istiod-ca-cert\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.361411 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.361390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-envoy\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.361623 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.361606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d03f90-a07f-414c-acff-92dbad4b8468-istio-podinfo\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.366202 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.366182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-istio-token\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.366202 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.366194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwx4c\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-kube-api-access-dwx4c\") pod \"e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.377134 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.377115 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:22.534790 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.534765 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5"] Jul 06 23:00:22.536818 ip-10-0-132-3 kubenswrapper[2577]: W0706 23:00:22.536787 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d03f90_a07f_414c_acff_92dbad4b8468.slice/crio-db6b2db47e9beb66b0d1a4cbde178e6719f0bba9dbcd36124519437e132e2614 WatchSource:0}: Error finding container db6b2db47e9beb66b0d1a4cbde178e6719f0bba9dbcd36124519437e132e2614: Status 404 returned error can't find the container with id db6b2db47e9beb66b0d1a4cbde178e6719f0bba9dbcd36124519437e132e2614 Jul 06 23:00:22.539070 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.539032 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:22.539135 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.539119 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:22.539177 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.539160 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:22.873461 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.873425 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" event={"ID":"42d03f90-a07f-414c-acff-92dbad4b8468","Type":"ContainerStarted","Data":"dba3001ae65599fc599522d38ad983314b18eae401439447831383cb08201ab4"} Jul 06 23:00:22.873663 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.873476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" event={"ID":"42d03f90-a07f-414c-acff-92dbad4b8468","Type":"ContainerStarted","Data":"db6b2db47e9beb66b0d1a4cbde178e6719f0bba9dbcd36124519437e132e2614"} Jul 06 23:00:22.895215 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:22.895154 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" podStartSLOduration=0.895131239 podStartE2EDuration="895.131239ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:22.890345169 +0000 UTC m=+1973.405984772" watchObservedRunningTime="2026-07-06 23:00:22.895131239 +0000 UTC m=+1973.410770845" Jul 06 23:00:23.377987 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:23.377938 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:23.382919 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:23.382895 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:23.878163 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:23.878125 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:23.879055 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:23.879034 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:24.837246 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:24.837217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:24.914823 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:24.914789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:24.983115 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:24.983079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:25.138944 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:25.138854 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:25.388551 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:25.388519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:25.488698 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:25.488668 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:29.348124 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:29.348044 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:30.840700 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:30.840327 2577 patch_prober.go:28] interesting pod/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:00:30.840700 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:30.840394 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 06 23:00:30.911028 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:30.910996 2577 generic.go:356] "Generic (PLEG): container finished" podID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerID="d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e" exitCode=0 Jul 06 23:00:30.911232 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:30.911073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" event={"ID":"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4","Type":"ContainerDied","Data":"d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e"} Jul 06 23:00:30.911524 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:30.911508 2577 scope.go:117] "RemoveContainer" containerID="d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e" Jul 06 23:00:30.912517 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:30.912490 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:30.912577 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:30.912556 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:30.912614 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:30.912588 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:31.917628 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:31.917585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" event={"ID":"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4","Type":"ContainerStarted","Data":"dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a"} Jul 06 23:00:32.233677 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:32.233600 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:32.233677 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:32.233633 2577 patch_prober.go:28] interesting pod/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:00:32.233858 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:32.233686 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 06 23:00:33.233404 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:33.233364 2577 patch_prober.go:28] interesting pod/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:00:33.233879 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:33.233421 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 06 23:00:34.233562 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:34.233522 2577 patch_prober.go:28] interesting pod/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:00:34.233942 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:34.233587 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 06 23:00:35.234125 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:35.234091 2577 patch_prober.go:28] interesting pod/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 06 23:00:35.234506 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:35.234145 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 06 23:00:36.237066 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.237040 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:36.237532 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.237286 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:36.238130 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.238112 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:36.943851 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.943817 2577 generic.go:356] "Generic (PLEG): container finished" podID="42d03f90-a07f-414c-acff-92dbad4b8468" containerID="dba3001ae65599fc599522d38ad983314b18eae401439447831383cb08201ab4" exitCode=0 Jul 06 23:00:36.944056 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.943890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" event={"ID":"42d03f90-a07f-414c-acff-92dbad4b8468","Type":"ContainerDied","Data":"dba3001ae65599fc599522d38ad983314b18eae401439447831383cb08201ab4"} Jul 06 23:00:36.944406 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.944388 2577 scope.go:117] "RemoveContainer" containerID="dba3001ae65599fc599522d38ad983314b18eae401439447831383cb08201ab4" Jul 06 23:00:36.945271 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.945246 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:36.945348 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.945335 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:36.945386 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:36.945371 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:37.442554 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:37.442524 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:37.835731 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:37.835643 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:37.953132 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:37.953089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:37.959053 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:37.959017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" event={"ID":"42d03f90-a07f-414c-acff-92dbad4b8468","Type":"ContainerStarted","Data":"d7206a253f8ff9d406f24e1e42fc3ee3c42490a76db439480c4ac88c2db0e306"} Jul 06 23:00:38.054364 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:38.054328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:38.200101 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:38.200058 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:38.377551 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:38.377508 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:38.378562 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:38.378539 2577 patch_prober.go:28] interesting pod/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 06 23:00:38.378624 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:38.378603 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 06 23:00:38.878755 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:38.878706 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:39.377914 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:39.377879 2577 patch_prober.go:28] interesting pod/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 06 23:00:39.378118 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:39.377992 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 06 23:00:40.377724 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:40.377681 2577 patch_prober.go:28] interesting pod/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 06 23:00:40.378133 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:40.377770 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 06 23:00:41.377612 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:41.377579 2577 patch_prober.go:28] interesting pod/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 06 23:00:41.377808 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:41.377635 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 06 23:00:42.382038 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:42.382009 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:42.382936 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:42.382917 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:43.774842 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:43.774813 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:43.833887 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:43.833819 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:44.034385 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:44.034295 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c"] Jul 06 23:00:44.034563 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:44.034533 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" containerID="cri-o://dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a" gracePeriod=30 Jul 06 23:00:44.058353 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:44.058324 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:44.280688 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:44.280655 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:44.432292 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:44.432239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:44.905722 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:44.905605 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:45.005277 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:45.005247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:45.109673 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:45.109632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:45.238389 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:45.238358 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:49.281069 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.281046 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:49.408553 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408532 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-token\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.408733 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408560 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-credential-socket\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.408733 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408598 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-certs\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.408733 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408636 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-envoy\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.408733 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408667 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qv8d\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-kube-api-access-9qv8d\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.408733 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408718 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-data\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.409050 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408748 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-socket\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.409050 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408777 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-podinfo\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.409050 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408813 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istiod-ca-cert\") pod \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\" (UID: \"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4\") " Jul 06 23:00:49.409050 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.408811 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:49.409260 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.409083 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:49.409260 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.409097 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:49.409260 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.409185 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:49.409418 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.409354 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:00:49.409670 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.409647 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:49.410802 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.410780 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:49.410935 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.410893 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:00:49.411213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.411190 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:49.411213 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.411203 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-kube-api-access-9qv8d" (OuterVolumeSpecName: "kube-api-access-9qv8d") pod "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" (UID: "b10bf2e9-3188-49dd-a65f-2bb6d0c906e4"). InnerVolumeSpecName "kube-api-access-9qv8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:49.509666 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.509636 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:49.509666 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.509659 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:49.509666 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.509668 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:49.509872 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.509677 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qv8d\" (UniqueName: \"kubernetes.io/projected/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-kube-api-access-9qv8d\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:49.509872 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.509689 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:49.509872 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.509698 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:49.509872 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.509706 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:49.509872 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:49.509713 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:50.022200 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.022164 2577 generic.go:356] "Generic (PLEG): container finished" podID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerID="dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a" exitCode=0 Jul 06 23:00:50.022363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.022209 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" Jul 06 23:00:50.022363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.022245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" event={"ID":"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4","Type":"ContainerDied","Data":"dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a"} Jul 06 23:00:50.022363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.022294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c" event={"ID":"b10bf2e9-3188-49dd-a65f-2bb6d0c906e4","Type":"ContainerDied","Data":"a7c13b22ad428449c2df3656635b4aa56f0dd57ceb99626f103b32f4e610af91"} Jul 06 23:00:50.022363 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.022317 2577 scope.go:117] "RemoveContainer" containerID="dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a" Jul 06 23:00:50.031166 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.031151 2577 scope.go:117] "RemoveContainer" containerID="d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e" Jul 06 23:00:50.038770 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.038755 2577 scope.go:117] "RemoveContainer" containerID="dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a" Jul 06 23:00:50.039010 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:00:50.038992 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a\": container with ID starting with dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a not found: ID does not exist" containerID="dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a" Jul 06 23:00:50.039058 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.039019 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a"} err="failed to get container status \"dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a\": rpc error: code = NotFound desc = could not find container \"dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a\": container with ID starting with dd4ca2fdf0b2a38c6dec3eefb0d2141e7e78a346d3dd9c427180580c1ca7543a not found: ID does not exist" Jul 06 23:00:50.039058 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.039034 2577 scope.go:117] "RemoveContainer" containerID="d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e" Jul 06 23:00:50.039257 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:00:50.039237 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e\": container with ID starting with d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e not found: ID does not exist" containerID="d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e" Jul 06 23:00:50.039293 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.039265 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e"} err="failed to get container status \"d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e\": rpc error: code = NotFound desc = could not find container \"d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e\": container with ID starting with d8342fd67627f5746461d22e270427249713ed0bb9a1617524d9fddefbbff56e not found: ID does not exist" Jul 06 23:00:50.043072 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.043051 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c"] Jul 06 23:00:50.048340 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.048316 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4a6cf6-openshift-default-59886b8587-n557c"] Jul 06 23:00:50.699333 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.699275 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:50.801048 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.801017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:50.936178 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.936142 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5"] Jul 06 23:00:50.936424 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.936397 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" containerID="cri-o://d7206a253f8ff9d406f24e1e42fc3ee3c42490a76db439480c4ac88c2db0e306" gracePeriod=30 Jul 06 23:00:50.958662 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:50.958595 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:51.020648 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.020619 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" path="/var/lib/kubelet/pods/b10bf2e9-3188-49dd-a65f-2bb6d0c906e4/volumes" Jul 06 23:00:51.180910 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.180869 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:51.523085 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.523051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:51.804579 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.804504 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb"] Jul 06 23:00:51.804905 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.804870 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" Jul 06 23:00:51.804905 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.804883 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" Jul 06 23:00:51.805007 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.804975 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" Jul 06 23:00:51.805007 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.804984 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" Jul 06 23:00:51.807560 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.807544 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.809794 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.809770 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-2ea5e8-openshift-default-dockercfg-wwqxb\"" Jul 06 23:00:51.819216 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.819194 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb"] Jul 06 23:00:51.827105 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.827079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:51.929215 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-istio-token\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.929390 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-certs\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.929390 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-credential-socket\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.929390 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-data\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.929390 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-socket\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.929390 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d8636c-f851-4320-98dd-a538b2859ecf-istio-podinfo\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.929571 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkhf\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-kube-api-access-dfkhf\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.929571 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-envoy\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:51.929571 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:51.929469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d8636c-f851-4320-98dd-a538b2859ecf-istiod-ca-cert\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.030430 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-data\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.030430 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-socket\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.030667 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d8636c-f851-4320-98dd-a538b2859ecf-istio-podinfo\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.030667 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkhf\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-kube-api-access-dfkhf\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.030667 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-envoy\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.030667 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d8636c-f851-4320-98dd-a538b2859ecf-istiod-ca-cert\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.030667 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-istio-token\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.030667 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-certs\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.031005 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030872 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-socket\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.031005 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-data\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.031005 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.030923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-credential-socket\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.031235 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.031001 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-certs\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.031235 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.031181 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-credential-socket\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.031406 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.031380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d8636c-f851-4320-98dd-a538b2859ecf-istiod-ca-cert\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.033009 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.032986 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-envoy\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.033328 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.033310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d8636c-f851-4320-98dd-a538b2859ecf-istio-podinfo\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.037927 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.037903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-istio-token\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.038234 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.038209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkhf\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-kube-api-access-dfkhf\") pod \"e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.118180 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.118130 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:52.251352 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.251327 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb"] Jul 06 23:00:52.252798 ip-10-0-132-3 kubenswrapper[2577]: W0706 23:00:52.252763 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d8636c_f851_4320_98dd_a538b2859ecf.slice/crio-310845ff7e046908c76c1e983b7f9add63cd950846359a89abac86f829f0326a WatchSource:0}: Error finding container 310845ff7e046908c76c1e983b7f9add63cd950846359a89abac86f829f0326a: Status 404 returned error can't find the container with id 310845ff7e046908c76c1e983b7f9add63cd950846359a89abac86f829f0326a Jul 06 23:00:52.254901 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.254871 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:52.255030 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.254933 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:52.255030 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.254984 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:00:52.381199 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:52.381118 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:53.040521 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:53.040486 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" event={"ID":"54d8636c-f851-4320-98dd-a538b2859ecf","Type":"ContainerStarted","Data":"c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e"} Jul 06 23:00:53.040998 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:53.040553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" event={"ID":"54d8636c-f851-4320-98dd-a538b2859ecf","Type":"ContainerStarted","Data":"310845ff7e046908c76c1e983b7f9add63cd950846359a89abac86f829f0326a"} Jul 06 23:00:53.058946 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:53.058898 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" podStartSLOduration=2.058883716 podStartE2EDuration="2.058883716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:00:53.057709383 +0000 UTC m=+2003.573348978" watchObservedRunningTime="2026-07-06 23:00:53.058883716 +0000 UTC m=+2003.574523320" Jul 06 23:00:53.118719 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:53.118687 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:53.123694 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:53.123671 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:54.045074 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:54.045042 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:54.046038 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:54.046017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:00:54.951133 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:54.951092 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:55.038802 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:55.038769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:55.096469 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:55.096433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:55.552510 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:55.552476 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:55.653676 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:55.653637 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:55.708577 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:55.708526 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:56.057509 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.057484 2577 generic.go:356] "Generic (PLEG): container finished" podID="42d03f90-a07f-414c-acff-92dbad4b8468" containerID="d7206a253f8ff9d406f24e1e42fc3ee3c42490a76db439480c4ac88c2db0e306" exitCode=0 Jul 06 23:00:56.057653 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.057566 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" event={"ID":"42d03f90-a07f-414c-acff-92dbad4b8468","Type":"ContainerDied","Data":"d7206a253f8ff9d406f24e1e42fc3ee3c42490a76db439480c4ac88c2db0e306"} Jul 06 23:00:56.057653 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.057638 2577 scope.go:117] "RemoveContainer" containerID="dba3001ae65599fc599522d38ad983314b18eae401439447831383cb08201ab4" Jul 06 23:00:56.189351 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.189331 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:56.265597 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.265520 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-envoy\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.265597 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.265561 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-credential-socket\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.265794 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.265606 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-certs\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.265794 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.265625 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwx4c\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-kube-api-access-dwx4c\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.265794 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.265672 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-istio-token\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.265794 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.265723 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-data\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.265794 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.265765 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-socket\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.266080 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.265811 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d03f90-a07f-414c-acff-92dbad4b8468-istiod-ca-cert\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.266080 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266004 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:56.266080 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266005 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:56.266080 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266051 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:56.266290 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266126 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d03f90-a07f-414c-acff-92dbad4b8468-istio-podinfo\") pod \"42d03f90-a07f-414c-acff-92dbad4b8468\" (UID: \"42d03f90-a07f-414c-acff-92dbad4b8468\") " Jul 06 23:00:56.266381 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266358 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42d03f90-a07f-414c-acff-92dbad4b8468-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:00:56.266513 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266497 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:56.266570 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266519 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:56.266570 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266535 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:56.266570 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266546 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42d03f90-a07f-414c-acff-92dbad4b8468-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:56.266708 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.266604 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-data" (OuterVolumeSpecName: "istio-data") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:56.267837 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.267805 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-kube-api-access-dwx4c" (OuterVolumeSpecName: "kube-api-access-dwx4c") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "kube-api-access-dwx4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:56.267972 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.267837 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-istio-token" (OuterVolumeSpecName: "istio-token") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:00:56.268111 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.268092 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:00:56.268273 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.268254 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/42d03f90-a07f-414c-acff-92dbad4b8468-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "42d03f90-a07f-414c-acff-92dbad4b8468" (UID: "42d03f90-a07f-414c-acff-92dbad4b8468"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:00:56.367922 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.367891 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:56.367922 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.367914 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42d03f90-a07f-414c-acff-92dbad4b8468-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:56.367922 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.367923 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42d03f90-a07f-414c-acff-92dbad4b8468-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:56.368129 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.367931 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwx4c\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-kube-api-access-dwx4c\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:56.368129 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:56.367939 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42d03f90-a07f-414c-acff-92dbad4b8468-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:00:57.062615 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:57.062580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" event={"ID":"42d03f90-a07f-414c-acff-92dbad4b8468","Type":"ContainerDied","Data":"db6b2db47e9beb66b0d1a4cbde178e6719f0bba9dbcd36124519437e132e2614"} Jul 06 23:00:57.062792 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:57.062615 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5" Jul 06 23:00:57.062792 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:57.062638 2577 scope.go:117] "RemoveContainer" containerID="d7206a253f8ff9d406f24e1e42fc3ee3c42490a76db439480c4ac88c2db0e306" Jul 06 23:00:57.083458 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:57.083436 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5"] Jul 06 23:00:57.087419 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:57.087397 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-280980-openshift-default-f7b6c6b55-l68r5"] Jul 06 23:00:59.020856 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:59.020822 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" path="/var/lib/kubelet/pods/42d03f90-a07f-414c-acff-92dbad4b8468/volumes" Jul 06 23:00:59.497574 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:59.497500 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:00:59.797985 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:00:59.797869 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:00.070743 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.070670 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz"] Jul 06 23:01:00.071135 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.071057 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" Jul 06 23:01:00.071135 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.071070 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" Jul 06 23:01:00.071135 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.071087 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" Jul 06 23:01:00.071135 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.071093 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" Jul 06 23:01:00.071135 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.071102 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" Jul 06 23:01:00.071135 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.071110 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b10bf2e9-3188-49dd-a65f-2bb6d0c906e4" containerName="istio-proxy" Jul 06 23:01:00.071396 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.071174 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" Jul 06 23:01:00.071396 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.071187 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d03f90-a07f-414c-acff-92dbad4b8468" containerName="istio-proxy" Jul 06 23:01:00.074030 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.074007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.076243 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.076220 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2de350-openshift-default-dockercfg-4mt9p\"" Jul 06 23:01:00.085019 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.084997 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz"] Jul 06 23:01:00.093189 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.093168 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:00.200767 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.200735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-credential-socket\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.200935 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.200775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-data\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.200935 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.200800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-podinfo\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.200935 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.200890 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-certs\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.201092 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.201012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-socket\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.201092 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.201038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-token\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.201164 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.201104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnzqc\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-kube-api-access-wnzqc\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.201164 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.201135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-envoy\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.201164 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.201153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istiod-ca-cert\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.301582 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.301541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-certs\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.301752 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.301606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-socket\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.301752 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.301621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-token\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.301752 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.301652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnzqc\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-kube-api-access-wnzqc\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.301752 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.301676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-envoy\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.301752 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.301694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istiod-ca-cert\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.302079 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.301930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-credential-socket\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.302079 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.302004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-data\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.302079 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.302031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-podinfo\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.302079 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.302004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-certs\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.302079 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.302063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-socket\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.302337 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.302298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-credential-socket\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.302394 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.302356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-data\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.302514 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.302497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istiod-ca-cert\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.303931 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.303905 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-envoy\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.304458 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.304436 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-podinfo\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.309218 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.309195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-token\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.309485 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.309465 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnzqc\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-kube-api-access-wnzqc\") pod \"e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.385449 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.385376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:00.445077 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.445042 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:00.538742 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.538710 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz"] Jul 06 23:01:00.539877 ip-10-0-132-3 kubenswrapper[2577]: W0706 23:01:00.539846 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c740e0a_edfd_4fca_bc9a_d53d9f54b223.slice/crio-3e77e77645b6dce329aa79dfe9856f2f2a3a389a54e7241d7afb5717abf09790 WatchSource:0}: Error finding container 3e77e77645b6dce329aa79dfe9856f2f2a3a389a54e7241d7afb5717abf09790: Status 404 returned error can't find the container with id 3e77e77645b6dce329aa79dfe9856f2f2a3a389a54e7241d7afb5717abf09790 Jul 06 23:01:00.541995 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.541926 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:00.542087 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.542038 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:00.542127 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:00.542106 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:01.086372 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:01.086330 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" event={"ID":"5c740e0a-edfd-4fca-bc9a-d53d9f54b223","Type":"ContainerStarted","Data":"f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc"} Jul 06 23:01:01.086830 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:01.086385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" event={"ID":"5c740e0a-edfd-4fca-bc9a-d53d9f54b223","Type":"ContainerStarted","Data":"3e77e77645b6dce329aa79dfe9856f2f2a3a389a54e7241d7afb5717abf09790"} Jul 06 23:01:01.111424 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:01.111377 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" podStartSLOduration=1.111362773 podStartE2EDuration="1.111362773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:01:01.109698845 +0000 UTC m=+2011.625338457" watchObservedRunningTime="2026-07-06 23:01:01.111362773 +0000 UTC m=+2011.627002377" Jul 06 23:01:01.386316 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:01.386231 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:01.391126 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:01.391101 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:02.090543 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:02.090511 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:02.091462 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:02.091440 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:03.946864 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:03.946829 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:04.045794 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:04.045748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:07.517243 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:07.517147 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:10.075766 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:10.075671 2577 patch_prober.go:28] interesting pod/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 23:01:10.076126 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:10.075757 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 23:01:10.130903 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:10.130874 2577 generic.go:356] "Generic (PLEG): container finished" podID="54d8636c-f851-4320-98dd-a538b2859ecf" containerID="c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e" exitCode=0 Jul 06 23:01:10.131029 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:10.130941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" event={"ID":"54d8636c-f851-4320-98dd-a538b2859ecf","Type":"ContainerDied","Data":"c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e"} Jul 06 23:01:10.131316 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:10.131301 2577 scope.go:117] "RemoveContainer" containerID="c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e" Jul 06 23:01:10.132322 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:10.132291 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:10.132407 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:10.132364 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:10.132407 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:10.132396 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:11.137564 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:11.137521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" event={"ID":"54d8636c-f851-4320-98dd-a538b2859ecf","Type":"ContainerStarted","Data":"75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08"} Jul 06 23:01:12.118429 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:12.118394 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:01:12.118621 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:12.118600 2577 patch_prober.go:28] interesting pod/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 06 23:01:12.118670 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:12.118646 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 06 23:01:13.119118 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:13.119082 2577 patch_prober.go:28] interesting pod/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 06 23:01:13.119617 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:13.119135 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 06 23:01:14.119294 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:14.119208 2577 patch_prober.go:28] interesting pod/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 06 23:01:14.119294 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:14.119281 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 06 23:01:15.118780 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:15.118735 2577 patch_prober.go:28] interesting pod/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 06 23:01:15.118981 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:15.118813 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 06 23:01:16.123519 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:16.123484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:01:16.123921 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:16.123839 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:01:16.124642 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:16.124625 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:01:16.826162 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:16.826127 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:16.926107 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:16.926069 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:17.092634 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.092553 2577 patch_prober.go:28] interesting pod/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 06 23:01:17.092634 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.092616 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 06 23:01:17.096317 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.096275 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:17.173486 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.173458 2577 generic.go:356] "Generic (PLEG): container finished" podID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerID="f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc" exitCode=0 Jul 06 23:01:17.173926 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.173496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" event={"ID":"5c740e0a-edfd-4fca-bc9a-d53d9f54b223","Type":"ContainerDied","Data":"f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc"} Jul 06 23:01:17.174082 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.174065 2577 scope.go:117] "RemoveContainer" containerID="f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc" Jul 06 23:01:17.175009 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.174982 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:17.175077 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.175049 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:17.175122 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.175084 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 23:01:17.194890 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:17.194855 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:18.185523 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:18.185486 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" event={"ID":"5c740e0a-edfd-4fca-bc9a-d53d9f54b223","Type":"ContainerStarted","Data":"8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd"} Jul 06 23:01:18.386168 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:18.386133 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:18.386348 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:18.386240 2577 patch_prober.go:28] interesting pod/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 06 23:01:18.386348 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:18.386294 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 06 23:01:19.385881 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:19.385845 2577 patch_prober.go:28] interesting pod/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 06 23:01:19.386297 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:19.385907 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 06 23:01:20.386767 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:20.386734 2577 patch_prober.go:28] interesting pod/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 06 23:01:20.387196 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:20.386800 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 06 23:01:21.386762 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:21.386726 2577 patch_prober.go:28] interesting pod/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 06 23:01:21.386942 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:21.386801 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 06 23:01:22.389847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:22.389818 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:22.390334 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:22.390190 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:22.390908 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:22.390892 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:01:23.935200 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:23.935162 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:25.761245 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:25.761212 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:25.861573 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:25.861535 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:42.862755 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:42.862719 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:01:54.719989 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:01:54.719941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:02:30.008415 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:02:30.008388 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 23:02:30.009617 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:02:30.009597 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 23:03:21.693383 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:03:21.693337 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:21.748220 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:03:21.748188 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:48.260661 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:03:48.260630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:03:49.198884 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:03:49.198852 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:05.613370 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:04:05.613336 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:04:38.114372 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:04:38.114318 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:07.604464 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:05:07.604435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:07.699493 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:05:07.699456 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:13.001882 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:05:13.001846 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:13.904747 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:05:13.904712 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:24.689438 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:05:24.689406 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:05:42.813461 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:05:42.813429 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:15.874816 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:15.874781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:18.077975 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:18.077933 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:18.179573 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:18.179539 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:26.023201 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:26.023123 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:26.123602 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:26.123568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:28.172689 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:28.172651 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:48.650030 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:48.649997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:49.597698 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:49.597664 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:50.639395 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:50.639364 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:51.034405 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:51.034375 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:51.134943 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:51.134907 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:51.261286 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:51.261250 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:06:56.116075 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:06:56.116041 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:09.651029 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:09.650994 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:09.751505 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:09.751473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:30.035904 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:30.035871 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 23:07:30.037177 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:30.037154 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 23:07:33.210705 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:33.210673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:33.458267 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:33.458234 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb"] Jul 06 23:07:33.458526 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:33.458480 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" containerID="cri-o://75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08" gracePeriod=30 Jul 06 23:07:33.475708 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:33.475648 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:33.719427 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:33.719391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:33.885748 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:33.885669 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:34.290645 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:34.290612 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:34.391060 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:34.391028 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:34.516804 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:34.516769 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:38.705023 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.705001 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:07:38.792172 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792108 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-socket\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792172 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792142 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-istio-token\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792172 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792163 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d8636c-f851-4320-98dd-a538b2859ecf-istio-podinfo\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792413 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792184 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-certs\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792413 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792206 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d8636c-f851-4320-98dd-a538b2859ecf-istiod-ca-cert\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792413 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792347 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-credential-socket\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792572 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792406 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:38.792572 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792446 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-envoy\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792572 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792490 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-data\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792572 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792503 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:38.792572 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792551 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfkhf\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-kube-api-access-dfkhf\") pod \"54d8636c-f851-4320-98dd-a538b2859ecf\" (UID: \"54d8636c-f851-4320-98dd-a538b2859ecf\") " Jul 06 23:07:38.792805 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792583 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:38.792805 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792621 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54d8636c-f851-4320-98dd-a538b2859ecf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:07:38.792910 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792859 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.792910 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792878 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.792910 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792892 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54d8636c-f851-4320-98dd-a538b2859ecf-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.792910 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.792905 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.793480 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.793455 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-data" (OuterVolumeSpecName: "istio-data") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:38.794484 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.794456 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-istio-token" (OuterVolumeSpecName: "istio-token") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:07:38.794700 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.794559 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-kube-api-access-dfkhf" (OuterVolumeSpecName: "kube-api-access-dfkhf") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "kube-api-access-dfkhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:07:38.794772 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.794722 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54d8636c-f851-4320-98dd-a538b2859ecf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:07:38.794772 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.794730 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54d8636c-f851-4320-98dd-a538b2859ecf" (UID: "54d8636c-f851-4320-98dd-a538b2859ecf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:38.893431 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.893409 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.893431 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.893429 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54d8636c-f851-4320-98dd-a538b2859ecf-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.893588 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.893438 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.893588 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.893446 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54d8636c-f851-4320-98dd-a538b2859ecf-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.893588 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.893454 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfkhf\" (UniqueName: \"kubernetes.io/projected/54d8636c-f851-4320-98dd-a538b2859ecf-kube-api-access-dfkhf\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:38.930530 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.930506 2577 generic.go:356] "Generic (PLEG): container finished" podID="54d8636c-f851-4320-98dd-a538b2859ecf" containerID="75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08" exitCode=0 Jul 06 23:07:38.930660 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.930574 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" Jul 06 23:07:38.930660 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.930590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" event={"ID":"54d8636c-f851-4320-98dd-a538b2859ecf","Type":"ContainerDied","Data":"75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08"} Jul 06 23:07:38.930660 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.930644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb" event={"ID":"54d8636c-f851-4320-98dd-a538b2859ecf","Type":"ContainerDied","Data":"310845ff7e046908c76c1e983b7f9add63cd950846359a89abac86f829f0326a"} Jul 06 23:07:38.930830 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.930667 2577 scope.go:117] "RemoveContainer" containerID="75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08" Jul 06 23:07:38.939266 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.939241 2577 scope.go:117] "RemoveContainer" containerID="c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e" Jul 06 23:07:38.946827 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.946808 2577 scope.go:117] "RemoveContainer" containerID="75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08" Jul 06 23:07:38.947081 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:07:38.947064 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08\": container with ID starting with 75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08 not found: ID does not exist" containerID="75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08" Jul 06 23:07:38.947137 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.947089 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08"} err="failed to get container status \"75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08\": rpc error: code = NotFound desc = could not find container \"75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08\": container with ID starting with 75043673c5c27c56f912fbbd4e33ac2e454007f2434691a73376cc5008b00d08 not found: ID does not exist" Jul 06 23:07:38.947137 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.947107 2577 scope.go:117] "RemoveContainer" containerID="c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e" Jul 06 23:07:38.947346 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:07:38.947329 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e\": container with ID starting with c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e not found: ID does not exist" containerID="c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e" Jul 06 23:07:38.947398 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.947351 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e"} err="failed to get container status \"c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e\": rpc error: code = NotFound desc = could not find container \"c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e\": container with ID starting with c36a6a696ad33b906ef04f2dbc64416adb38e537b4e68fd4e58e87bdfd0b291e not found: ID does not exist" Jul 06 23:07:38.951033 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.951012 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb"] Jul 06 23:07:38.957140 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:38.957117 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-2ea5e8-openshift-default-cbb8f5d87-xgbpb"] Jul 06 23:07:39.021057 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:39.021026 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" path="/var/lib/kubelet/pods/54d8636c-f851-4320-98dd-a538b2859ecf/volumes" Jul 06 23:07:40.181293 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:40.181251 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:40.281416 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:40.281371 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:40.436081 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:40.435998 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz"] Jul 06 23:07:40.436246 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:40.436202 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" containerID="cri-o://8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd" gracePeriod=30 Jul 06 23:07:40.459480 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:40.459454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:40.685429 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:40.685396 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:45.683652 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.683628 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:07:45.754570 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754500 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-token\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.754570 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754562 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-credential-socket\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.754776 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754589 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnzqc\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-kube-api-access-wnzqc\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.754776 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754610 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-certs\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.754776 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754635 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-envoy\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.754776 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754758 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-data\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.755028 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754817 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istiod-ca-cert\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.755028 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754886 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-socket\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.755028 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754918 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-podinfo\") pod \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\" (UID: \"5c740e0a-edfd-4fca-bc9a-d53d9f54b223\") " Jul 06 23:07:45.755028 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754925 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:45.755028 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.754947 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:45.755303 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.755278 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 23:07:45.755370 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.755309 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-credential-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.755370 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.755331 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-certs\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.755551 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.755528 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:45.755847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.755813 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:45.756778 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.756751 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 23:07:45.756878 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.756837 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:07:45.756878 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.756855 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-kube-api-access-wnzqc" (OuterVolumeSpecName: "kube-api-access-wnzqc") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "kube-api-access-wnzqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 23:07:45.756985 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.756936 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c740e0a-edfd-4fca-bc9a-d53d9f54b223" (UID: "5c740e0a-edfd-4fca-bc9a-d53d9f54b223"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 23:07:45.856772 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.856733 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnzqc\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-kube-api-access-wnzqc\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.856772 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.856765 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-envoy\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.856772 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.856774 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-data\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.856772 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.856781 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istiod-ca-cert\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.857068 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.856789 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-workload-socket\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.857068 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.856798 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-podinfo\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.857068 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.856806 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c740e0a-edfd-4fca-bc9a-d53d9f54b223-istio-token\") on node \"ip-10-0-132-3.ec2.internal\" DevicePath \"\"" Jul 06 23:07:45.964074 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.964039 2577 generic.go:356] "Generic (PLEG): container finished" podID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerID="8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd" exitCode=0 Jul 06 23:07:45.964237 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.964087 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" Jul 06 23:07:45.964237 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.964121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" event={"ID":"5c740e0a-edfd-4fca-bc9a-d53d9f54b223","Type":"ContainerDied","Data":"8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd"} Jul 06 23:07:45.964237 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.964174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz" event={"ID":"5c740e0a-edfd-4fca-bc9a-d53d9f54b223","Type":"ContainerDied","Data":"3e77e77645b6dce329aa79dfe9856f2f2a3a389a54e7241d7afb5717abf09790"} Jul 06 23:07:45.964237 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.964195 2577 scope.go:117] "RemoveContainer" containerID="8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd" Jul 06 23:07:45.973273 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.973253 2577 scope.go:117] "RemoveContainer" containerID="f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc" Jul 06 23:07:45.980673 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.980658 2577 scope.go:117] "RemoveContainer" containerID="8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd" Jul 06 23:07:45.980925 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:07:45.980906 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd\": container with ID starting with 8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd not found: ID does not exist" containerID="8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd" Jul 06 23:07:45.981018 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.980934 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd"} err="failed to get container status \"8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd\": rpc error: code = NotFound desc = could not find container \"8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd\": container with ID starting with 8a64951aef3c46b5cbab5bd3baff01362bc058b286068b5848a8e624e51728bd not found: ID does not exist" Jul 06 23:07:45.981018 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.980963 2577 scope.go:117] "RemoveContainer" containerID="f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc" Jul 06 23:07:45.981211 ip-10-0-132-3 kubenswrapper[2577]: E0706 23:07:45.981189 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc\": container with ID starting with f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc not found: ID does not exist" containerID="f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc" Jul 06 23:07:45.981255 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.981214 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc"} err="failed to get container status \"f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc\": rpc error: code = NotFound desc = could not find container \"f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc\": container with ID starting with f982bdce50b82d7070ad52efeee37b7044edd032329d39ee4d95cb93a4b29efc not found: ID does not exist" Jul 06 23:07:45.986571 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.986547 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz"] Jul 06 23:07:45.990760 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:45.990743 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2de350-openshift-default-5565654d59-d5qhz"] Jul 06 23:07:46.455165 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:46.455139 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xwdmn_6758f205-a0f3-4a52-b1e9-3dc1fc98700e/server/0.log" Jul 06 23:07:46.815212 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:46.815140 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c9b4d57b-ttz9q_2923c721-0bcb-4f4e-827f-218743b2ab64/copy-manifests/0.log" Jul 06 23:07:46.827333 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:46.827310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c9b4d57b-ttz9q_2923c721-0bcb-4f4e-827f-218743b2ab64/manager/0.log" Jul 06 23:07:47.020594 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:47.020564 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" path="/var/lib/kubelet/pods/5c740e0a-edfd-4fca-bc9a-d53d9f54b223/volumes" Jul 06 23:07:47.166175 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:47.166145 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:47.266883 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:47.266851 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:48.486091 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:48.486064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8dzhb_6927399c-f018-4ee6-a93b-d46659aadc72/manager/0.log" Jul 06 23:07:48.597157 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:48.597134 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7rlxj_83499374-05bb-4210-90a5-6b87728a9272/manager/0.log" Jul 06 23:07:48.826905 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:48.826839 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jh9xm_1ccb1c71-c53b-42bd-abcf-7474300d6ad5/registry-server/0.log" Jul 06 23:07:49.197866 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:49.197844 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hlnfl_87a2dc5d-4ef7-4564-a8f9-3970b558b6f2/manager/0.log" Jul 06 23:07:49.558052 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:49.557941 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb67845wrs_5ed18acf-0c65-4d91-9988-00a2cc67c976/istio-proxy/0.log" Jul 06 23:07:49.682555 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:49.682529 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lb5k6_33c171f6-b4f1-4840-bfc8-5358f43f43dc/discovery/0.log" Jul 06 23:07:49.903376 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:49.903311 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfdb4967c-tcrhl_6bb821f2-a090-4361-a790-40a008a1d3f5/kube-auth-proxy/0.log" Jul 06 23:07:50.021225 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:50.021199 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d76dc_bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda/istio-proxy/1.log" Jul 06 23:07:50.837592 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:50.837564 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dbnc7_6efc7530-516d-4b52-a945-682380f75510/main/0.log" Jul 06 23:07:51.069369 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:51.069346 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxsd8s_0f5f777b-9c23-4e9a-a3e5-f000afc40206/main/0.log" Jul 06 23:07:55.175936 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:55.175848 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:55.277526 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:55.277493 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:07:58.005972 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:58.005928 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9p5mm_9fede43d-c065-4ba5-8d6e-6c504e6754aa/global-pull-secret-syncer/0.log" Jul 06 23:07:58.094680 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:58.094652 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" Jul 06 23:07:58.177458 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:07:58.177434 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-3.ec2.internal_fea9d108671560738be1beffe7846653/haproxy/0.log" Jul 06 23:08:03.538161 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:03.538131 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8dzhb_6927399c-f018-4ee6-a93b-d46659aadc72/manager/0.log" Jul 06 23:08:03.565744 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:03.565721 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7rlxj_83499374-05bb-4210-90a5-6b87728a9272/manager/0.log" Jul 06 23:08:03.637862 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:03.637841 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jh9xm_1ccb1c71-c53b-42bd-abcf-7474300d6ad5/registry-server/0.log" Jul 06 23:08:03.874197 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:03.874124 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hlnfl_87a2dc5d-4ef7-4564-a8f9-3970b558b6f2/manager/0.log" Jul 06 23:08:05.994489 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:05.994466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztnl9_3051b8ca-43a4-49f4-9db0-7deca37fdf90/node-exporter/0.log" Jul 06 23:08:06.021906 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:06.021883 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztnl9_3051b8ca-43a4-49f4-9db0-7deca37fdf90/kube-rbac-proxy/0.log" Jul 06 23:08:06.042667 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:06.042644 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ztnl9_3051b8ca-43a4-49f4-9db0-7deca37fdf90/init-textfile/0.log" Jul 06 23:08:08.191358 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191325 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69"] Jul 06 23:08:08.191847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191724 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" Jul 06 23:08:08.191847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191742 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" Jul 06 23:08:08.191847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191760 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" Jul 06 23:08:08.191847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191769 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" Jul 06 23:08:08.191847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191783 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" Jul 06 23:08:08.191847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191792 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" Jul 06 23:08:08.191847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191805 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" Jul 06 23:08:08.191847 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191813 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" Jul 06 23:08:08.192138 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191896 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" Jul 06 23:08:08.192138 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191906 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d8636c-f851-4320-98dd-a538b2859ecf" containerName="istio-proxy" Jul 06 23:08:08.192138 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.191912 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c740e0a-edfd-4fca-bc9a-d53d9f54b223" containerName="istio-proxy" Jul 06 23:08:08.194825 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.194807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.196886 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.196865 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjzlh\"/\"default-dockercfg-dmwst\"" Jul 06 23:08:08.196963 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.196867 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjzlh\"/\"openshift-service-ca.crt\"" Jul 06 23:08:08.197769 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.197753 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjzlh\"/\"kube-root-ca.crt\"" Jul 06 23:08:08.204168 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.204148 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69"] Jul 06 23:08:08.238161 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.238135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-podres\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.238262 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.238168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-sys\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.238262 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.238187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-lib-modules\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.238262 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.238220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdl8d\" (UniqueName: \"kubernetes.io/projected/8f844c34-b761-40a4-a16f-a25a97366812-kube-api-access-hdl8d\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.238423 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.238297 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-proc\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339306 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-podres\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339422 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-sys\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339422 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339327 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-lib-modules\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339422 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdl8d\" (UniqueName: \"kubernetes.io/projected/8f844c34-b761-40a4-a16f-a25a97366812-kube-api-access-hdl8d\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339422 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-proc\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339422 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-sys\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339634 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339465 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-proc\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339668 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-lib-modules\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.339705 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.339665 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f844c34-b761-40a4-a16f-a25a97366812-podres\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.346618 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.346598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdl8d\" (UniqueName: \"kubernetes.io/projected/8f844c34-b761-40a4-a16f-a25a97366812-kube-api-access-hdl8d\") pod \"perf-node-gather-daemonset-5th69\" (UID: \"8f844c34-b761-40a4-a16f-a25a97366812\") " pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.407576 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.407551 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/2.log" Jul 06 23:08:08.411923 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.411906 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-f225l_ba1f3831-e11d-477f-85d5-e0330cc02f05/console-operator/3.log" Jul 06 23:08:08.505429 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.505365 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:08.635510 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:08.635487 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69"] Jul 06 23:08:08.637378 ip-10-0-132-3 kubenswrapper[2577]: W0706 23:08:08.637355 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f844c34_b761_40a4_a16f_a25a97366812.slice/crio-c22facba4d97b906c83fae97a075e4d4b91e510fdfac6f3a2881a7e38b0f29da WatchSource:0}: Error finding container c22facba4d97b906c83fae97a075e4d4b91e510fdfac6f3a2881a7e38b0f29da: Status 404 returned error can't find the container with id c22facba4d97b906c83fae97a075e4d4b91e510fdfac6f3a2881a7e38b0f29da Jul 06 23:08:09.080991 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:09.080930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" event={"ID":"8f844c34-b761-40a4-a16f-a25a97366812","Type":"ContainerStarted","Data":"04bd7ed00e9910f804eb2c5997d97e72445fdf0af0baff8d6bbb4d7aeefe761d"} Jul 06 23:08:09.081164 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:09.081004 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" event={"ID":"8f844c34-b761-40a4-a16f-a25a97366812","Type":"ContainerStarted","Data":"c22facba4d97b906c83fae97a075e4d4b91e510fdfac6f3a2881a7e38b0f29da"} Jul 06 23:08:09.081164 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:09.081032 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:09.097597 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:09.097542 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" podStartSLOduration=1.097529489 podStartE2EDuration="1.097529489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:08:09.094626346 +0000 UTC m=+2439.610265951" watchObservedRunningTime="2026-07-06 23:08:09.097529489 +0000 UTC m=+2439.613169093" Jul 06 23:08:09.498729 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:09.498699 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-8dxsz_cab84536-bacb-4d98-9113-c56f55190ef0/volume-data-source-validator/0.log" Jul 06 23:08:10.542896 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:10.542867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9f4s_d2c61271-8422-4b25-b7c8-a128bd188946/dns/0.log" Jul 06 23:08:10.561540 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:10.561514 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9f4s_d2c61271-8422-4b25-b7c8-a128bd188946/kube-rbac-proxy/0.log" Jul 06 23:08:10.633792 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:10.633766 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grtsn_ce5521f0-f29c-412c-b9d7-7d957d94c2b4/dns-node-resolver/0.log" Jul 06 23:08:11.182303 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:11.182275 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8655b7bfd9-5gg5b_ff6d9a6f-9a7c-4e9f-98a7-2fd7df8b0dd6/registry/0.log" Jul 06 23:08:11.228012 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:11.227981 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fjrnw_05812575-ef7b-462f-ba38-b7a7dce7ef68/node-ca/0.log" Jul 06 23:08:12.244222 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:12.244182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb67845wrs_5ed18acf-0c65-4d91-9988-00a2cc67c976/istio-proxy/0.log" Jul 06 23:08:12.347672 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:12.347645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lb5k6_33c171f6-b4f1-4840-bfc8-5358f43f43dc/discovery/0.log" Jul 06 23:08:12.392325 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:12.392300 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfdb4967c-tcrhl_6bb821f2-a090-4361-a790-40a008a1d3f5/kube-auth-proxy/0.log" Jul 06 23:08:12.423141 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:12.423118 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d76dc_bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda/istio-proxy/0.log" Jul 06 23:08:12.450073 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:12.450051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d76dc_bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda/istio-proxy/1.log" Jul 06 23:08:13.259999 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:13.259975 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sd79s_3293b7a8-e16f-45e1-9657-62b1bac7bd29/serve-healthcheck-canary/0.log" Jul 06 23:08:13.828796 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:13.828770 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pv4fl_ca36c93c-ba5a-44da-b1bd-326edff908da/kube-rbac-proxy/0.log" Jul 06 23:08:13.848614 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:13.848590 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pv4fl_ca36c93c-ba5a-44da-b1bd-326edff908da/exporter/0.log" Jul 06 23:08:13.868933 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:13.868915 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pv4fl_ca36c93c-ba5a-44da-b1bd-326edff908da/extractor/0.log" Jul 06 23:08:15.094459 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:15.094429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjzlh/perf-node-gather-daemonset-5th69" Jul 06 23:08:16.402193 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:16.402167 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xwdmn_6758f205-a0f3-4a52-b1e9-3dc1fc98700e/server/0.log" Jul 06 23:08:16.615486 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:16.615455 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c9b4d57b-ttz9q_2923c721-0bcb-4f4e-827f-218743b2ab64/manager/0.log" Jul 06 23:08:16.635741 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:16.635716 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c9b4d57b-ttz9q_2923c721-0bcb-4f4e-827f-218743b2ab64/copy-manifests/0.log" Jul 06 23:08:17.696457 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:17.696425 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4dnm2_dd4ddf05-5296-4df5-a1de-fddb9a7a2726/konnectivity-agent/0.log" limit=1024 Jul 06 23:08:18.328983 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:18.328886 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb67845wrs_5ed18acf-0c65-4d91-9988-00a2cc67c976/istio-proxy/0.log" Jul 06 23:08:18.442263 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:18.442234 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lb5k6_33c171f6-b4f1-4840-bfc8-5358f43f43dc/discovery/0.log" Jul 06 23:08:18.468200 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:18.468167 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfdb4967c-tcrhl_6bb821f2-a090-4361-a790-40a008a1d3f5/kube-auth-proxy/0.log" Jul 06 23:08:18.487151 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:18.487125 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d76dc_bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda/istio-proxy/0.log" Jul 06 23:08:18.513272 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:18.513247 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d76dc_bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda/istio-proxy/1.log" Jul 06 23:08:19.830513 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:19.830485 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb67845wrs_5ed18acf-0c65-4d91-9988-00a2cc67c976/istio-proxy/0.log" Jul 06 23:08:19.925757 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:19.925731 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lb5k6_33c171f6-b4f1-4840-bfc8-5358f43f43dc/discovery/0.log" Jul 06 23:08:19.955336 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:19.955315 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cfdb4967c-tcrhl_6bb821f2-a090-4361-a790-40a008a1d3f5/kube-auth-proxy/0.log" Jul 06 23:08:19.973917 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:19.973892 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d76dc_bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda/istio-proxy/0.log" Jul 06 23:08:19.999721 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:19.999697 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-d76dc_bbb8e6dc-ae26-46f6-92a4-e87af6bc4fda/istio-proxy/1.log" Jul 06 23:08:23.051960 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:23.051918 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-mtgl4_a65aef45-e15e-477f-a261-53557944b317/migrator/0.log" Jul 06 23:08:23.071805 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:23.071779 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-mtgl4_a65aef45-e15e-477f-a261-53557944b317/graceful-termination/0.log" Jul 06 23:08:23.415198 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:23.415164 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8wzwv_dff7a4cb-8915-4940-ba8a-5239effff1e4/kube-storage-version-migrator-operator/1.log" Jul 06 23:08:23.415988 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:23.415969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8wzwv_dff7a4cb-8915-4940-ba8a-5239effff1e4/kube-storage-version-migrator-operator/0.log" Jul 06 23:08:24.377826 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.377755 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dj4jg_5027701b-787f-4cf2-a44e-6812631aadae/kube-multus-additional-cni-plugins/0.log" Jul 06 23:08:24.401071 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.401045 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dj4jg_5027701b-787f-4cf2-a44e-6812631aadae/egress-router-binary-copy/0.log" Jul 06 23:08:24.420873 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.420850 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dj4jg_5027701b-787f-4cf2-a44e-6812631aadae/cni-plugins/0.log" Jul 06 23:08:24.441313 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.441288 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dj4jg_5027701b-787f-4cf2-a44e-6812631aadae/bond-cni-plugin/0.log" Jul 06 23:08:24.461062 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.461041 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dj4jg_5027701b-787f-4cf2-a44e-6812631aadae/routeoverride-cni/0.log" Jul 06 23:08:24.484173 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.484153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dj4jg_5027701b-787f-4cf2-a44e-6812631aadae/whereabouts-cni-bincopy/0.log" Jul 06 23:08:24.504410 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.504389 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dj4jg_5027701b-787f-4cf2-a44e-6812631aadae/whereabouts-cni/0.log" Jul 06 23:08:24.861307 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.861277 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hpr82_437ff35e-8d5f-4369-adf1-7a06710422b6/kube-multus/0.log" Jul 06 23:08:24.938024 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.937995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5zvtm_b175a52e-2c98-4890-a694-c9e95cbc6c1b/network-metrics-daemon/0.log" Jul 06 23:08:24.956150 ip-10-0-132-3 kubenswrapper[2577]: I0706 23:08:24.956128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5zvtm_b175a52e-2c98-4890-a694-c9e95cbc6c1b/kube-rbac-proxy/0.log"