Aug 05 18:59:26.205004 ip-10-0-131-134 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Aug 05 18:59:26.205018 ip-10-0-131-134 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Aug 05 18:59:26.205027 ip-10-0-131-134 systemd[1]: kubelet.service: Failed with result 'resources'. Aug 05 18:59:26.205384 ip-10-0-131-134 systemd[1]: Failed to start Kubernetes Kubelet. Aug 05 18:59:37.480823 ip-10-0-131-134 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Aug 05 18:59:37.480843 ip-10-0-131-134 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 363e856ed70548e4bf079d2cb78fcea8 -- Aug 05 19:01:13.850085 ip-10-0-131-134 systemd[1]: Starting Kubernetes Kubelet... Aug 05 19:01:14.301237 ip-10-0-131-134 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 19:01:14.301237 ip-10-0-131-134 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 05 19:01:14.301237 ip-10-0-131-134 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 19:01:14.301237 ip-10-0-131-134 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 05 19:01:14.301237 ip-10-0-131-134 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 19:01:14.304143 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.304049 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 05 19:01:14.309209 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309191 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 19:01:14.309209 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309208 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 19:01:14.309209 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309212 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309216 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309220 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309223 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309226 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309229 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309232 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309235 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309238 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309240 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309243 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309246 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309251 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309255 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309260 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309263 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309266 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309268 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309271 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309274 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 19:01:14.309314 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309277 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309280 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309283 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309285 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309288 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309290 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309293 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309296 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309299 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309301 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309304 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309307 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309310 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309313 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309316 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309319 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309321 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309324 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309327 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309329 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 19:01:14.309841 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309332 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309335 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309340 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309343 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309347 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309350 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309353 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309356 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309358 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309361 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309364 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309366 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309369 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309372 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309374 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309378 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309380 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309383 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309387 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309390 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 19:01:14.310660 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309393 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309396 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309399 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309401 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309404 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309407 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309410 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309413 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309416 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309418 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309421 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309424 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309426 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309429 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309432 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309436 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309439 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309441 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309447 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 19:01:14.311417 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309450 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309453 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309456 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309459 2578 feature_gate.go:328] unrecognized feature gate: Example Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309463 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309467 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309470 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309473 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309475 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309478 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309481 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309484 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309486 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309489 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309492 2578 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309495 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309497 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.309500 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311142 2578 feature_gate.go:328] unrecognized feature gate: Example Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311163 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 19:01:14.311912 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311169 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311174 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311178 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311183 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311187 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311191 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311197 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311207 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311248 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311255 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311261 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311266 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311271 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311286 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311291 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311295 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311324 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311334 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311340 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311344 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 19:01:14.312401 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311350 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311502 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311511 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311516 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311519 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311522 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311525 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311530 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311535 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311539 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311542 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311545 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311549 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311552 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311556 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311559 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311562 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311565 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311567 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311570 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 19:01:14.312927 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311574 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311577 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311579 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311582 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311585 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311587 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311590 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311593 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311595 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311599 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311601 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311604 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311607 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311612 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311616 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311620 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311622 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311626 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311628 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 19:01:14.313422 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311631 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311634 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311636 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311639 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311642 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311645 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311648 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311651 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311654 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311657 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311660 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311662 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311666 2578 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311668 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311671 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311673 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311676 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311679 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311681 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311684 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 19:01:14.313903 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311687 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311689 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311692 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311695 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311697 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311700 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311704 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311707 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311710 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311713 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311717 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311720 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311722 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311726 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311730 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311733 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311735 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.311739 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313090 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 19:01:14.314414 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313099 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313102 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313105 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313108 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313111 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313114 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313117 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313119 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313122 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313124 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313127 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313130 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313132 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313135 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313138 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313141 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313143 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313146 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313148 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313151 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 19:01:14.314888 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313154 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313156 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313159 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313161 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313164 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313166 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313169 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313171 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313175 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313179 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313183 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313186 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313189 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313192 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313195 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313197 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313200 2578 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313202 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313205 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 19:01:14.315389 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313207 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313210 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313213 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313215 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313218 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313220 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313223 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313226 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313229 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313232 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313235 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313237 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313240 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313242 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313245 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313247 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313250 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313253 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313255 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313258 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 19:01:14.315898 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313260 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313263 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313266 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313270 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313274 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313278 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313282 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313285 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313287 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313290 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313293 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313295 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313298 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313300 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313303 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313305 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313308 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313310 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313313 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 19:01:14.316383 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313315 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313318 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313321 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313324 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313328 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313331 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313334 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313337 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313340 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313342 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313346 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313349 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313351 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313354 2578 feature_gate.go:328] unrecognized feature gate: Example Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313357 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313359 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313362 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313364 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313367 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.313369 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 19:01:14.316879 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313438 2578 flags.go:64] FLAG: --address="0.0.0.0" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313446 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313453 2578 flags.go:64] FLAG: --anonymous-auth="true" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313459 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313465 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313470 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313477 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313484 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313489 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313491 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313495 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313498 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313501 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313504 2578 flags.go:64] FLAG: --cgroup-root="" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313507 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313510 2578 flags.go:64] FLAG: --client-ca-file="" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313514 2578 flags.go:64] FLAG: --cloud-provider="external" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313517 2578 flags.go:64] FLAG: --cluster-dns="[]" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313522 2578 flags.go:64] FLAG: --cluster-domain="" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313524 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313527 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313531 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313534 2578 flags.go:64] FLAG: --container-log-max-files="5" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313538 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 05 19:01:14.317407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313541 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313544 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313547 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313551 2578 flags.go:64] FLAG: --contention-profiling="false" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313554 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313557 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313560 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313563 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313567 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313570 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313573 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313576 2578 flags.go:64] FLAG: --enable-load-reader="false" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313579 2578 flags.go:64] FLAG: --enable-server="true" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313582 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313586 2578 flags.go:64] FLAG: --event-burst="100" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313589 2578 flags.go:64] FLAG: --event-qps="50" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313592 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313595 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313598 2578 flags.go:64] FLAG: --eviction-hard="" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313602 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313605 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313608 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313611 2578 flags.go:64] FLAG: --eviction-soft="" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313614 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313617 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 05 19:01:14.318006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313620 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313623 2578 flags.go:64] FLAG: --experimental-mounter-path="" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313626 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313629 2578 flags.go:64] FLAG: --fail-swap-on="true" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313632 2578 flags.go:64] FLAG: --feature-gates="" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313636 2578 flags.go:64] FLAG: --file-check-frequency="20s" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313641 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313645 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313648 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313651 2578 flags.go:64] FLAG: --healthz-port="10248" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313654 2578 flags.go:64] FLAG: --help="false" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313657 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313660 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313663 2578 flags.go:64] FLAG: --http-check-frequency="20s" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313666 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313670 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313673 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313676 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313679 2578 flags.go:64] FLAG: --image-service-endpoint="" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313682 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313685 2578 flags.go:64] FLAG: --kube-api-burst="100" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313687 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313690 2578 flags.go:64] FLAG: --kube-api-qps="50" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313693 2578 flags.go:64] FLAG: --kube-reserved="" Aug 05 19:01:14.318623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313696 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313699 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313702 2578 flags.go:64] FLAG: --kubelet-cgroups="" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313705 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313707 2578 flags.go:64] FLAG: --lock-file="" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313710 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313713 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313716 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313721 2578 flags.go:64] FLAG: --log-json-split-stream="false" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313725 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313728 2578 flags.go:64] FLAG: --log-text-split-stream="false" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313731 2578 flags.go:64] FLAG: --logging-format="text" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313734 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313737 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313741 2578 flags.go:64] FLAG: --manifest-url="" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313744 2578 flags.go:64] FLAG: --manifest-url-header="" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313765 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313769 2578 flags.go:64] FLAG: --max-open-files="1000000" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313773 2578 flags.go:64] FLAG: --max-pods="110" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313776 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313779 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313782 2578 flags.go:64] FLAG: --memory-manager-policy="None" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313785 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313788 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313791 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 05 19:01:14.319239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313794 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313802 2578 flags.go:64] FLAG: --node-status-max-images="50" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313806 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313809 2578 flags.go:64] FLAG: --oom-score-adj="-999" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313812 2578 flags.go:64] FLAG: --pod-cidr="" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313815 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313820 2578 flags.go:64] FLAG: --pod-manifest-path="" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313823 2578 flags.go:64] FLAG: --pod-max-pids="-1" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313826 2578 flags.go:64] FLAG: --pods-per-core="0" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313829 2578 flags.go:64] FLAG: --port="10250" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313832 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313835 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03f45867e460c4d13" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313838 2578 flags.go:64] FLAG: --qos-reserved="" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313841 2578 flags.go:64] FLAG: --read-only-port="10255" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313844 2578 flags.go:64] FLAG: --register-node="true" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313847 2578 flags.go:64] FLAG: --register-with-taints="" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313851 2578 flags.go:64] FLAG: --registry-burst="10" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313855 2578 flags.go:64] FLAG: --registry-qps="5" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313860 2578 flags.go:64] FLAG: --reserved-cpus="" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313863 2578 flags.go:64] FLAG: --reserved-memory="" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313866 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313869 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313873 2578 flags.go:64] FLAG: --rotate-certificates="false" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313876 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313879 2578 flags.go:64] FLAG: --runonce="false" Aug 05 19:01:14.319928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313882 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313885 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313888 2578 flags.go:64] FLAG: --seccomp-default="false" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313891 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313894 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313897 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313900 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313903 2578 flags.go:64] FLAG: --storage-driver-password="root" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313906 2578 flags.go:64] FLAG: --storage-driver-secure="false" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313910 2578 flags.go:64] FLAG: --storage-driver-table="stats" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313913 2578 flags.go:64] FLAG: --storage-driver-user="root" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313916 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313919 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313922 2578 flags.go:64] FLAG: --system-cgroups="" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313925 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313931 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313933 2578 flags.go:64] FLAG: --tls-cert-file="" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313936 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313941 2578 flags.go:64] FLAG: --tls-min-version="" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313945 2578 flags.go:64] FLAG: --tls-private-key-file="" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313948 2578 flags.go:64] FLAG: --topology-manager-policy="none" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313950 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313953 2578 flags.go:64] FLAG: --topology-manager-scope="container" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313956 2578 flags.go:64] FLAG: --v="2" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313960 2578 flags.go:64] FLAG: --version="false" Aug 05 19:01:14.320574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313967 2578 flags.go:64] FLAG: --vmodule="" Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313970 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.313973 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314090 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314095 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314098 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314101 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314103 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314106 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314108 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314111 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314113 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314116 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314118 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314121 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314124 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314126 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314129 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314132 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314134 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 19:01:14.321253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314137 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314139 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314141 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314144 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314147 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314149 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314152 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314154 2578 feature_gate.go:328] unrecognized feature gate: Example Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314157 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314160 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314162 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314165 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314169 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314172 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314175 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314177 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314181 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314184 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314186 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314189 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 19:01:14.321735 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314191 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314194 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314197 2578 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314199 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314202 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314205 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314207 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314210 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314212 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314215 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314218 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314220 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314223 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314225 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314228 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314230 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314233 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314236 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314240 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 19:01:14.322257 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314244 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314247 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314250 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314253 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314255 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314259 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314262 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314265 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314268 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314272 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314275 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314278 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314280 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314283 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314285 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314288 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314291 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314293 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314296 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 19:01:14.322720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314299 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314301 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314304 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314307 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314309 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314312 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314314 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314317 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314320 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314322 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314327 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314330 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314333 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314335 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314338 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314340 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314343 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314345 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314350 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 19:01:14.323191 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314353 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314357 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314362 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314367 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.314370 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.315183 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.322550 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.322571 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.322590 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.322597 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322655 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322661 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322665 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322669 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 19:01:14.323673 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322673 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322676 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322679 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322682 2578 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322685 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322688 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322691 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322693 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322696 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322699 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322702 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322705 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322709 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322712 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322715 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322717 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322720 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322723 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322726 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322729 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 19:01:14.324048 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322732 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322735 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322738 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322740 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322743 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322763 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322768 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322771 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322774 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322777 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322780 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322783 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322786 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322789 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322792 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322795 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322797 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322800 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322803 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322805 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 19:01:14.324538 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322808 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322811 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322814 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322817 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322820 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322823 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322827 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322830 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322833 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322836 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322839 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322842 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322845 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322848 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322850 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322853 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322856 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322859 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322862 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 19:01:14.325127 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322865 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322868 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322870 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322873 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322875 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322878 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322881 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322883 2578 feature_gate.go:328] unrecognized feature gate: Example Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322886 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322888 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322891 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322894 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322896 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322899 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322901 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322904 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322907 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322910 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322913 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322916 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 19:01:14.325618 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322918 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322921 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322924 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322927 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322929 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322932 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322935 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322938 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322940 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322943 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322946 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322948 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322952 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322955 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322957 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 19:01:14.326206 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.322961 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.322966 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323099 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323104 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323107 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323110 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323113 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323116 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323119 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323122 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323125 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323128 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323130 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323133 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 19:01:14.326583 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323136 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323139 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323142 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323144 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323147 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323150 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323153 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323155 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323158 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323160 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323163 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323165 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323168 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323170 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323173 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323176 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323179 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323182 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323184 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 19:01:14.326961 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323187 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323189 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323192 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323195 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323197 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323200 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323203 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323206 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323208 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323211 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323213 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323216 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323218 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323222 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323224 2578 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323228 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323231 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323235 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323239 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 19:01:14.327419 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323242 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323245 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323248 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323251 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323254 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323256 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323259 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323261 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323264 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323267 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323270 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323273 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323276 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323278 2578 feature_gate.go:328] unrecognized feature gate: Example Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323281 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323283 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323286 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323288 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323291 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323293 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323296 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 19:01:14.327906 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323299 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323302 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323304 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323307 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323309 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323312 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323315 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323318 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323321 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323323 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323326 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323329 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323331 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323334 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323336 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323339 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323341 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323344 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323346 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323349 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 19:01:14.328410 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323351 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323354 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323357 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323360 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323362 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323365 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323368 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:14.323372 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.323377 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.323504 2578 server.go:962] "Client rotation is on, will bootstrap in background" Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.325975 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.327723 2578 server.go:1019] "Starting client certificate rotation" Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.327783 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 19:01:14.328937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.327821 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 19:01:14.330642 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.330627 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 19:01:14.331801 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.331781 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 19:01:14.345766 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.345724 2578 log.go:25] "Validated CRI v1 runtime API" Aug 05 19:01:14.348521 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.348500 2578 log.go:25] "Validated CRI v1 image API" Aug 05 19:01:14.350294 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.350259 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 05 19:01:14.353675 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.353650 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 823869e9-e82c-409c-800a-7dd56019081a:/dev/nvme0n1p3 9f21e058-9efa-47e4-8176-5b16ac1b588c:/dev/nvme0n1p4] Aug 05 19:01:14.353779 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.353674 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 05 19:01:14.359540 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.359516 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 19:01:14.360376 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.360237 2578 manager.go:216] Machine: {Timestamp:2026-08-05 19:01:14.358797663 +0000 UTC m=+0.378860702 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101044 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c5f3ba8d62a543a4b753150cf7d59 SystemUUID:ec2c5f3b-a8d6-2a54-3a4b-753150cf7d59 BootID:363e856e-d705-48e4-bf07-9d2cb78fcea8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:ec:2a:0c:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:ec:2a:0c:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:51:f9:9f:10:b7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 05 19:01:14.360376 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.360366 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 05 19:01:14.360541 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.360471 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 05 19:01:14.363865 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.363828 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 05 19:01:14.364020 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.363869 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 05 19:01:14.364704 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.364691 2578 topology_manager.go:138] "Creating topology manager with none policy" Aug 05 19:01:14.364802 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.364706 2578 container_manager_linux.go:309] "Creating device plugin manager" Aug 05 19:01:14.364802 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.364714 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 19:01:14.365405 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.365387 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 19:01:14.366662 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.366650 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 05 19:01:14.371983 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.371965 2578 state_mem.go:36] "Initialized new in-memory state store" Aug 05 19:01:14.372126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.372116 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 05 19:01:14.372169 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.372150 2578 kubelet.go:486] "Attempting to sync node with API server" Aug 05 19:01:14.372169 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.372162 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 05 19:01:14.372228 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.372177 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 05 19:01:14.372228 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.372188 2578 kubelet.go:398] "Adding apiserver pod source" Aug 05 19:01:14.372228 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.372199 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 05 19:01:14.372685 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.372670 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 19:01:14.372739 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.372692 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 19:01:14.375862 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.375844 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 05 19:01:14.377580 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.377566 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 05 19:01:14.377644 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.377597 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 05 19:01:14.379001 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.378988 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 05 19:01:14.379052 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379010 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 05 19:01:14.379052 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379021 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 05 19:01:14.379052 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379031 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 05 19:01:14.379052 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379044 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379053 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379066 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379074 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379084 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379092 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379114 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379124 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379154 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 05 19:01:14.379160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.379161 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 05 19:01:14.382383 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.382369 2578 server.go:1268] "Started kubelet" Aug 05 19:01:14.382914 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.382485 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 05 19:01:14.382914 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.382729 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 05 19:01:14.382914 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.382814 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 05 19:01:14.383321 ip-10-0-131-134 systemd[1]: Started Kubernetes Kubelet. Aug 05 19:01:14.384251 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.384234 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 05 19:01:14.384569 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.384523 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 05 19:01:14.384648 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.384587 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 05 19:01:14.384648 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.384638 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 05 19:01:14.389236 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.389209 2578 server.go:310] "Adding debug handlers to kubelet server" Aug 05 19:01:14.391038 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.391015 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 05 19:01:14.392102 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.390944 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-134.ec2.internal.18c8fdf377de487a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-134.ec2.internal,UID:ip-10-0-131-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-134.ec2.internal,},FirstTimestamp:2026-08-05 19:01:14.38233817 +0000 UTC m=+0.402401209,LastTimestamp:2026-08-05 19:01:14.38233817 +0000 UTC m=+0.402401209,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-134.ec2.internal,}" Aug 05 19:01:14.392688 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.392661 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 05 19:01:14.392831 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.392675 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 05 19:01:14.392929 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.392910 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:14.393515 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393489 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 05 19:01:14.393515 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393491 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 05 19:01:14.393515 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393517 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 05 19:01:14.393682 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393623 2578 reconstruct.go:97] "Volume reconstruction finished" Aug 05 19:01:14.393682 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393631 2578 reconciler.go:29] "Reconciler: start to sync state" Aug 05 19:01:14.393682 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393672 2578 factory.go:55] Registering systemd factory Aug 05 19:01:14.393848 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393696 2578 factory.go:223] Registration of the systemd container factory successfully Aug 05 19:01:14.393997 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393980 2578 factory.go:153] Registering CRI-O factory Aug 05 19:01:14.393997 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.393996 2578 factory.go:223] Registration of the crio container factory successfully Aug 05 19:01:14.394090 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.394055 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 05 19:01:14.394090 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.394082 2578 factory.go:103] Registering Raw factory Aug 05 19:01:14.394178 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.394095 2578 manager.go:1196] Started watching for new ooms in manager Aug 05 19:01:14.394505 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.394492 2578 manager.go:349] Starting recovery of all containers Aug 05 19:01:14.398994 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.398967 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 05 19:01:14.399097 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.399044 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 05 19:01:14.406226 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.406212 2578 manager.go:354] Recovery completed Aug 05 19:01:14.407064 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.407035 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vg2jm" Aug 05 19:01:14.411249 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.411236 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 19:01:14.413204 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.413184 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientMemory" Aug 05 19:01:14.413297 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.413222 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 19:01:14.413297 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.413237 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientPID" Aug 05 19:01:14.413949 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.413935 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 05 19:01:14.414016 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.413949 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 05 19:01:14.414016 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.413951 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 19:01:14.414016 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.413969 2578 state_mem.go:36] "Initialized new in-memory state store" Aug 05 19:01:14.414370 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.414355 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vg2jm" Aug 05 19:01:14.414838 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.414819 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientMemory" Aug 05 19:01:14.414913 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.414848 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 19:01:14.414913 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.414858 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientPID" Aug 05 19:01:14.415279 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.415186 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-134.ec2.internal.18c8fdf379b54598 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-134.ec2.internal,UID:ip-10-0-131-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-134.ec2.internal,},FirstTimestamp:2026-08-05 19:01:14.413204888 +0000 UTC m=+0.433267930,LastTimestamp:2026-08-05 19:01:14.413204888 +0000 UTC m=+0.433267930,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-134.ec2.internal,}" Aug 05 19:01:14.416219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.416206 2578 policy_none.go:49] "None policy: Start" Aug 05 19:01:14.416282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.416222 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 05 19:01:14.416282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.416233 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 05 19:01:14.418192 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.418179 2578 policy_none.go:47] "Start" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.467570 2578 manager.go:337] "Starting Device Plugin manager" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.467827 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.467839 2578 server.go:87] "Starting device plugin registration server" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.468074 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.468084 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.468192 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.468307 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.468317 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.468913 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 05 19:01:14.473067 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.468963 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:14.529789 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.529742 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 05 19:01:14.531012 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.530982 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 05 19:01:14.531135 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.531026 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 05 19:01:14.531135 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.531048 2578 kubelet.go:2448] "Starting kubelet main sync loop" Aug 05 19:01:14.531135 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.531084 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 05 19:01:14.534336 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.534317 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 19:01:14.568311 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.568226 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 19:01:14.569397 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.569378 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientMemory" Aug 05 19:01:14.569506 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.569415 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 19:01:14.569506 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.569429 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientPID" Aug 05 19:01:14.569506 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.569459 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.580060 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.580038 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.580175 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.580066 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-134.ec2.internal\": node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:14.597646 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.597615 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:14.631405 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.631366 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal"] Aug 05 19:01:14.631595 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.631478 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 19:01:14.632505 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.632489 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientMemory" Aug 05 19:01:14.632584 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.632517 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 19:01:14.632584 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.632527 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientPID" Aug 05 19:01:14.634927 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.634915 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 19:01:14.635079 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.635064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.635115 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.635097 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 19:01:14.635691 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.635667 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientMemory" Aug 05 19:01:14.635820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.635698 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 19:01:14.635820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.635709 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientPID" Aug 05 19:01:14.635820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.635669 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientMemory" Aug 05 19:01:14.635820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.635734 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 19:01:14.635820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.635768 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientPID" Aug 05 19:01:14.638074 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.638058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.638158 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.638091 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 19:01:14.639075 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.639061 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientMemory" Aug 05 19:01:14.639135 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.639091 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 19:01:14.639135 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.639102 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeHasSufficientPID" Aug 05 19:01:14.662612 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.662589 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-134.ec2.internal\" not found" node="ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.667266 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.667246 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-134.ec2.internal\" not found" node="ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.698696 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.698657 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:14.795766 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.795716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12cbc8a05d620b6aab5e8ac03ce312fa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-134.ec2.internal\" (UID: \"12cbc8a05d620b6aab5e8ac03ce312fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.795894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.795787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a2d9cdea45beecb0aa22f28a26b4ee8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal\" (UID: \"9a2d9cdea45beecb0aa22f28a26b4ee8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.795894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.795819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2d9cdea45beecb0aa22f28a26b4ee8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal\" (UID: \"9a2d9cdea45beecb0aa22f28a26b4ee8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.799022 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.799004 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:14.897098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.897024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a2d9cdea45beecb0aa22f28a26b4ee8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal\" (UID: \"9a2d9cdea45beecb0aa22f28a26b4ee8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.897098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.897072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2d9cdea45beecb0aa22f28a26b4ee8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal\" (UID: \"9a2d9cdea45beecb0aa22f28a26b4ee8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.897098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.897092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12cbc8a05d620b6aab5e8ac03ce312fa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-134.ec2.internal\" (UID: \"12cbc8a05d620b6aab5e8ac03ce312fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.897253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.897137 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a2d9cdea45beecb0aa22f28a26b4ee8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal\" (UID: \"9a2d9cdea45beecb0aa22f28a26b4ee8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.897253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.897146 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2d9cdea45beecb0aa22f28a26b4ee8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal\" (UID: \"9a2d9cdea45beecb0aa22f28a26b4ee8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.897253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.897202 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12cbc8a05d620b6aab5e8ac03ce312fa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-134.ec2.internal\" (UID: \"12cbc8a05d620b6aab5e8ac03ce312fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.899169 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:14.899146 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:14.969768 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.969719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:14.969864 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:14.969784 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" Aug 05 19:01:15.000143 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.000109 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:15.100303 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.100250 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:15.200852 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.200748 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-134.ec2.internal\" not found" Aug 05 19:01:15.271939 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.271909 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 19:01:15.293749 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.293721 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" Aug 05 19:01:15.302628 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.302607 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 19:01:15.304147 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.304129 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" Aug 05 19:01:15.317591 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.317568 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 19:01:15.326304 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.326279 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 05 19:01:15.326457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.326433 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 19:01:15.326524 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.326469 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 19:01:15.373768 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.373719 2578 apiserver.go:52] "Watching apiserver" Aug 05 19:01:15.392993 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.392957 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 05 19:01:15.394196 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.394172 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 05 19:01:15.394557 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.394535 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-44jz2","kube-system/global-pull-secret-syncer-fdhbz","kube-system/konnectivity-agent-g85lw","openshift-cluster-node-tuning-operator/tuned-gw7hk","openshift-image-registry/node-ca-64mxw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal","openshift-multus/multus-additional-cni-plugins-nzl76","openshift-network-operator/iptables-alerter-lxpxw","kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h","openshift-dns/node-resolver-j9m66","openshift-multus/multus-4n6rc","openshift-multus/network-metrics-daemon-g727w","openshift-network-diagnostics/network-check-target-njw24"] Aug 05 19:01:15.397540 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.397521 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.399915 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.399890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.400028 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.399958 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:15.402207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.402148 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 05 19:01:15.402207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.402152 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 05 19:01:15.402390 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.402220 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 05 19:01:15.402390 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.402245 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 05 19:01:15.402390 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.402257 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tdfrg\"" Aug 05 19:01:15.402390 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.402155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 05 19:01:15.402390 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.402155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 05 19:01:15.402390 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.402332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:15.405303 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.405279 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m78n9\"" Aug 05 19:01:15.405713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.405691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.405850 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.405749 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 05 19:01:15.406160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.406140 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 05 19:01:15.406750 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.406732 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 19:01:15.408182 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.408163 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 05 19:01:15.408260 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.408246 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sxvw8\"" Aug 05 19:01:15.408407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.408390 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 05 19:01:15.409050 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.409029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.411553 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.411533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.413474 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.413454 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 05 19:01:15.413969 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.413798 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 05 19:01:15.413969 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.413895 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 05 19:01:15.414187 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.414164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.414588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.414570 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2zlrq\"" Aug 05 19:01:15.416676 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.416657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.418273 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.418253 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 05 19:01:15.418362 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.418298 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 05 19:01:15.418362 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.418258 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 05 19:01:15.418596 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.418582 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 05 19:01:15.418666 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.418653 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 05 19:01:15.419103 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.419086 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2n98z\"" Aug 05 19:01:15.419374 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.419357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.419723 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.419683 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 18:56:14 +0000 UTC" deadline="2028-03-04 17:18:09.261512298 +0000 UTC" Aug 05 19:01:15.419771 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.419724 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13846h16m53.841791366s" Aug 05 19:01:15.421167 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.421150 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 05 19:01:15.421258 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.421202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 05 19:01:15.421960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.421943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.422497 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.422481 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 05 19:01:15.423086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.423070 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 05 19:01:15.423154 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.423110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5jlf2\"" Aug 05 19:01:15.423296 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.423275 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 05 19:01:15.423376 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.423348 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 05 19:01:15.424223 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.424203 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 05 19:01:15.424540 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.424524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:15.424628 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.424610 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:15.427655 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.427638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:15.427719 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.427706 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:15.430227 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.430211 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j6ftm\"" Aug 05 19:01:15.430327 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.430284 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 05 19:01:15.430515 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.430502 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 05 19:01:15.430569 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.430561 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72gss\"" Aug 05 19:01:15.435488 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.435471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mnk9t\"" Aug 05 19:01:15.454211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.454158 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zfzqn" Aug 05 19:01:15.469797 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.469764 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zfzqn" Aug 05 19:01:15.495880 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.495851 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 05 19:01:15.500234 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-cni-netd\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.500234 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.500234 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-sys-fs\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.500460 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-tuned\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.500460 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-cnibin\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.500460 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-os-release\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.500460 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-cni-bin\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.500460 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2m2l\" (UniqueName: \"kubernetes.io/projected/832f67d7-7e03-4676-99ba-c36f8a94d0fe-kube-api-access-q2m2l\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.500460 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500426 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-kubelet\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-slash\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-cnibin\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-etc-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-kubernetes\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-os-release\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-cni-multus\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-var-lib-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.500713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovnkube-config\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovnkube-script-lib\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-modprobe-d\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-systemd\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-lib-modules\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-etc-kubernetes\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.500964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-cni-bin\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501026 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-kubelet-config\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-registration-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-host\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prm5g\" (UniqueName: \"kubernetes.io/projected/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-kube-api-access-prm5g\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-system-cni-dir\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.501186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld5ch\" (UniqueName: \"kubernetes.io/projected/90798647-ba8c-4c35-9b74-4daf31a0e798-kube-api-access-ld5ch\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-hostroot\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovn-node-metrics-cert\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-serviceca\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g89fr\" (UniqueName: \"kubernetes.io/projected/f8b682b2-bedb-4dbf-a585-50cccff11ef4-kube-api-access-g89fr\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-k8s-cni-cncf-io\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-netns\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-daemon-config\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-systemd\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-env-overrides\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1143878-16e2-46b6-b88f-57c719b461e0-agent-certs\") pod \"konnectivity-agent-g85lw\" (UID: \"a1143878-16e2-46b6-b88f-57c719b461e0\") " pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysctl-conf\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8b682b2-bedb-4dbf-a585-50cccff11ef4-tmp-dir\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.501867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.501636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.502483 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89d5b716-1f71-49c2-b967-4a71c37023a7-iptables-alerter-script\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.502483 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysctl-d\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.502588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-sys\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.502588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b065af-4c2e-43b1-850a-624bac4ee609-tmp\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.502588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-kubelet\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.502750 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtj22\" (UniqueName: \"kubernetes.io/projected/d81923d9-f4de-436a-a04e-b6276d577090-kube-api-access-rtj22\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:15.502750 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-ovn\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.502875 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-dbus\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.502875 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cz9j\" (UniqueName: \"kubernetes.io/projected/15840901-259a-4fd6-9a1d-501f989876e7-kube-api-access-7cz9j\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.502979 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsm4l\" (UniqueName: \"kubernetes.io/projected/eb91555c-4f92-4e92-91da-483dcf02fe2d-kube-api-access-gsm4l\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.502979 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1143878-16e2-46b6-b88f-57c719b461e0-konnectivity-ca\") pod \"konnectivity-agent-g85lw\" (UID: \"a1143878-16e2-46b6-b88f-57c719b461e0\") " pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:15.503070 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.502978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-socket-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.503070 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.503070 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.503291 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.503291 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89d5b716-1f71-49c2-b967-4a71c37023a7-host-slash\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.503291 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.503291 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysconfig\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.503494 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.503494 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-cni-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.503494 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-run-netns\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.503494 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tm72\" (UniqueName: \"kubernetes.io/projected/89d5b716-1f71-49c2-b967-4a71c37023a7-kube-api-access-5tm72\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.503710 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-device-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.503710 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.503710 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f8b682b2-bedb-4dbf-a585-50cccff11ef4-hosts-file\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.503710 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-system-cni-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.503960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-conf-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.503960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:15.503960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-log-socket\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.503960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-var-lib-kubelet\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.503960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/832f67d7-7e03-4676-99ba-c36f8a94d0fe-cni-binary-copy\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.503960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-socket-dir-parent\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.504293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.503992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-run\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.504293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.504023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxfnj\" (UniqueName: \"kubernetes.io/projected/b5b065af-4c2e-43b1-850a-624bac4ee609-kube-api-access-fxfnj\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.504293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.504067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-host\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.504293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.504106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-multus-certs\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.504293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.504179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:15.504543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.504301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-systemd-units\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.504543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.504333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.504543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.504384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-node-log\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.605327 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-slash\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.605327 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-cnibin\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-etc-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605412 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-slash\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-kubernetes\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605449 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-cnibin\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-os-release\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605416 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-etc-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605498 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-kubernetes\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605556 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-os-release\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.605577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-cni-multus\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-var-lib-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovnkube-config\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605677 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-cni-multus\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovnkube-script-lib\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-var-lib-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-modprobe-d\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-systemd\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-lib-modules\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605810 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-systemd\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-etc-kubernetes\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-cni-bin\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-etc-kubernetes\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605850 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-modprobe-d\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-lib-modules\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-cni-bin\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.605987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-kubelet-config\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-registration-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.606037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-host\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prm5g\" (UniqueName: \"kubernetes.io/projected/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-kube-api-access-prm5g\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606091 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-host\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606096 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-registration-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-system-cni-dir\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606149 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-kubelet-config\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606163 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld5ch\" (UniqueName: \"kubernetes.io/projected/90798647-ba8c-4c35-9b74-4daf31a0e798-kube-api-access-ld5ch\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-hostroot\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-system-cni-dir\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovn-node-metrics-cert\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-serviceca\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g89fr\" (UniqueName: \"kubernetes.io/projected/f8b682b2-bedb-4dbf-a585-50cccff11ef4-kube-api-access-g89fr\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606284 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-hostroot\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-k8s-cni-cncf-io\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606351 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-k8s-cni-cncf-io\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovnkube-config\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovnkube-script-lib\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.606921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-netns\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-daemon-config\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-systemd\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-netns\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-env-overrides\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1143878-16e2-46b6-b88f-57c719b461e0-agent-certs\") pod \"konnectivity-agent-g85lw\" (UID: \"a1143878-16e2-46b6-b88f-57c719b461e0\") " pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606621 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-systemd\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysctl-conf\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606669 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8b682b2-bedb-4dbf-a585-50cccff11ef4-tmp-dir\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606814 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysctl-conf\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606854 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-serviceca\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89d5b716-1f71-49c2-b967-4a71c37023a7-iptables-alerter-script\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysctl-d\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-sys\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b065af-4c2e-43b1-850a-624bac4ee609-tmp\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.606991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-kubelet\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.607790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtj22\" (UniqueName: \"kubernetes.io/projected/d81923d9-f4de-436a-a04e-b6276d577090-kube-api-access-rtj22\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-ovn\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-dbus\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607111 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb91555c-4f92-4e92-91da-483dcf02fe2d-env-overrides\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607140 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8b682b2-bedb-4dbf-a585-50cccff11ef4-tmp-dir\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607151 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-daemon-config\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cz9j\" (UniqueName: \"kubernetes.io/projected/15840901-259a-4fd6-9a1d-501f989876e7-kube-api-access-7cz9j\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607181 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-kubelet\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607226 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-ovn\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-sys\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsm4l\" (UniqueName: \"kubernetes.io/projected/eb91555c-4f92-4e92-91da-483dcf02fe2d-kube-api-access-gsm4l\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1143878-16e2-46b6-b88f-57c719b461e0-konnectivity-ca\") pod \"konnectivity-agent-g85lw\" (UID: \"a1143878-16e2-46b6-b88f-57c719b461e0\") " pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-socket-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607458 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89d5b716-1f71-49c2-b967-4a71c37023a7-iptables-alerter-script\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.608785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607502 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysctl-d\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89d5b716-1f71-49c2-b967-4a71c37023a7-host-slash\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.607533 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-dbus\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607632 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-run-openvswitch\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.607649 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret podName:6d01c6b1-66c2-42ea-aa85-82e940e1cd30 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:16.107613923 +0000 UTC m=+2.127676954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret") pod "global-pull-secret-syncer-fdhbz" (UID: "6d01c6b1-66c2-42ea-aa85-82e940e1cd30") : object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607675 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89d5b716-1f71-49c2-b967-4a71c37023a7-host-slash\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysconfig\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-cni-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-run-netns\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tm72\" (UniqueName: \"kubernetes.io/projected/89d5b716-1f71-49c2-b967-4a71c37023a7-kube-api-access-5tm72\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-device-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.607979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f8b682b2-bedb-4dbf-a585-50cccff11ef4-hosts-file\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.609637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-cni-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-system-cni-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608026 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-conf-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608058 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-system-cni-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-log-socket\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-var-lib-kubelet\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608147 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-socket-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/832f67d7-7e03-4676-99ba-c36f8a94d0fe-cni-binary-copy\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-socket-dir-parent\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608216 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1143878-16e2-46b6-b88f-57c719b461e0-konnectivity-ca\") pod \"konnectivity-agent-g85lw\" (UID: \"a1143878-16e2-46b6-b88f-57c719b461e0\") " pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-run\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxfnj\" (UniqueName: \"kubernetes.io/projected/b5b065af-4c2e-43b1-850a-624bac4ee609-kube-api-access-fxfnj\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-host\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-multus-certs\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608284 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-run-netns\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.610509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608396 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-device-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-sysconfig\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608601 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-socket-dir-parent\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608658 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-run\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/832f67d7-7e03-4676-99ba-c36f8a94d0fe-cni-binary-copy\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608877 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-log-socket\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b065af-4c2e-43b1-850a-624bac4ee609-var-lib-kubelet\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608949 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-cni-binary-copy\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608956 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-host\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-multus-conf-dir\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f8b682b2-bedb-4dbf-a585-50cccff11ef4-hosts-file\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.608992 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-run-multus-certs\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.609051 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-systemd-units\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.609105 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs podName:d81923d9-f4de-436a-a04e-b6276d577090 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:16.10908579 +0000 UTC m=+2.129148824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs") pod "network-metrics-daemon-g727w" (UID: "d81923d9-f4de-436a-a04e-b6276d577090") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:15.611138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609116 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-systemd-units\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-node-log\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-cni-netd\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-sys-fs\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-tuned\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-node-log\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-cnibin\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-os-release\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609319 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-cni-bin\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-cni-netd\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2m2l\" (UniqueName: \"kubernetes.io/projected/832f67d7-7e03-4676-99ba-c36f8a94d0fe-kube-api-access-q2m2l\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-cnibin\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-kubelet\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15840901-259a-4fd6-9a1d-501f989876e7-sys-fs\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.611708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609509 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/832f67d7-7e03-4676-99ba-c36f8a94d0fe-host-var-lib-cni-bin\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.612314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90798647-ba8c-4c35-9b74-4daf31a0e798-os-release\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.612314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609612 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90798647-ba8c-4c35-9b74-4daf31a0e798-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.612314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.609627 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb91555c-4f92-4e92-91da-483dcf02fe2d-host-kubelet\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.612314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.610862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b065af-4c2e-43b1-850a-624bac4ee609-tmp\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.612314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.611170 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb91555c-4f92-4e92-91da-483dcf02fe2d-ovn-node-metrics-cert\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.612314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.611382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1143878-16e2-46b6-b88f-57c719b461e0-agent-certs\") pod \"konnectivity-agent-g85lw\" (UID: \"a1143878-16e2-46b6-b88f-57c719b461e0\") " pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:15.612314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.611603 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5b065af-4c2e-43b1-850a-624bac4ee609-etc-tuned\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.620118 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.620092 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g89fr\" (UniqueName: \"kubernetes.io/projected/f8b682b2-bedb-4dbf-a585-50cccff11ef4-kube-api-access-g89fr\") pod \"node-resolver-j9m66\" (UID: \"f8b682b2-bedb-4dbf-a585-50cccff11ef4\") " pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.620307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.620244 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prm5g\" (UniqueName: \"kubernetes.io/projected/5c0e56e0-d8f4-4537-91b2-97035dbbc26e-kube-api-access-prm5g\") pod \"node-ca-64mxw\" (UID: \"5c0e56e0-d8f4-4537-91b2-97035dbbc26e\") " pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.620563 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.620535 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 19:01:15.620563 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.620559 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 19:01:15.620705 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.620573 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lk6rl for pod openshift-network-diagnostics/network-check-target-njw24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:15.620705 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:15.620654 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl podName:ea1dfe1a-3cef-4843-a3d7-58328cfe82a5 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:16.120634798 +0000 UTC m=+2.140697840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lk6rl" (UniqueName: "kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl") pod "network-check-target-njw24" (UID: "ea1dfe1a-3cef-4843-a3d7-58328cfe82a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:15.622212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.622154 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2m2l\" (UniqueName: \"kubernetes.io/projected/832f67d7-7e03-4676-99ba-c36f8a94d0fe-kube-api-access-q2m2l\") pod \"multus-4n6rc\" (UID: \"832f67d7-7e03-4676-99ba-c36f8a94d0fe\") " pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.622876 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.622636 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtj22\" (UniqueName: \"kubernetes.io/projected/d81923d9-f4de-436a-a04e-b6276d577090-kube-api-access-rtj22\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:15.622876 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.622823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tm72\" (UniqueName: \"kubernetes.io/projected/89d5b716-1f71-49c2-b967-4a71c37023a7-kube-api-access-5tm72\") pod \"iptables-alerter-lxpxw\" (UID: \"89d5b716-1f71-49c2-b967-4a71c37023a7\") " pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.623994 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.623970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsm4l\" (UniqueName: \"kubernetes.io/projected/eb91555c-4f92-4e92-91da-483dcf02fe2d-kube-api-access-gsm4l\") pod \"ovnkube-node-44jz2\" (UID: \"eb91555c-4f92-4e92-91da-483dcf02fe2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.624513 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.624482 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cz9j\" (UniqueName: \"kubernetes.io/projected/15840901-259a-4fd6-9a1d-501f989876e7-kube-api-access-7cz9j\") pod \"aws-ebs-csi-driver-node-q9z6h\" (UID: \"15840901-259a-4fd6-9a1d-501f989876e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.624988 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.624966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld5ch\" (UniqueName: \"kubernetes.io/projected/90798647-ba8c-4c35-9b74-4daf31a0e798-kube-api-access-ld5ch\") pod \"multus-additional-cni-plugins-nzl76\" (UID: \"90798647-ba8c-4c35-9b74-4daf31a0e798\") " pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.625325 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.625294 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxfnj\" (UniqueName: \"kubernetes.io/projected/b5b065af-4c2e-43b1-850a-624bac4ee609-kube-api-access-fxfnj\") pod \"tuned-gw7hk\" (UID: \"b5b065af-4c2e-43b1-850a-624bac4ee609\") " pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.640472 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.640430 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2d9cdea45beecb0aa22f28a26b4ee8.slice/crio-7928fb17a4e7ca95b1dced36e47ee85a61ce2c417dbc6d8358dc7aa2e14e81a2 WatchSource:0}: Error finding container 7928fb17a4e7ca95b1dced36e47ee85a61ce2c417dbc6d8358dc7aa2e14e81a2: Status 404 returned error can't find the container with id 7928fb17a4e7ca95b1dced36e47ee85a61ce2c417dbc6d8358dc7aa2e14e81a2 Aug 05 19:01:15.645098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.645077 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 19:01:15.651248 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.651222 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cbc8a05d620b6aab5e8ac03ce312fa.slice/crio-bc322f2dc181a3cc119e76132b49a16adede3692145efc380cd0a023026e87ef WatchSource:0}: Error finding container bc322f2dc181a3cc119e76132b49a16adede3692145efc380cd0a023026e87ef: Status 404 returned error can't find the container with id bc322f2dc181a3cc119e76132b49a16adede3692145efc380cd0a023026e87ef Aug 05 19:01:15.728609 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.728503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:15.738402 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.738366 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb91555c_4f92_4e92_91da_483dcf02fe2d.slice/crio-4f74553f85d8fc27f91619622cb6ebc28dd4f86da8dbe0846bdb0e4aa07752a0 WatchSource:0}: Error finding container 4f74553f85d8fc27f91619622cb6ebc28dd4f86da8dbe0846bdb0e4aa07752a0: Status 404 returned error can't find the container with id 4f74553f85d8fc27f91619622cb6ebc28dd4f86da8dbe0846bdb0e4aa07752a0 Aug 05 19:01:15.748003 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.747973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:15.755287 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.755267 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" Aug 05 19:01:15.757613 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.757587 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1143878_16e2_46b6_b88f_57c719b461e0.slice/crio-48d57f1c2ff502ebe10b681de7a8b25ad955cefbc598fc38f901c6e4ad58846d WatchSource:0}: Error finding container 48d57f1c2ff502ebe10b681de7a8b25ad955cefbc598fc38f901c6e4ad58846d: Status 404 returned error can't find the container with id 48d57f1c2ff502ebe10b681de7a8b25ad955cefbc598fc38f901c6e4ad58846d Aug 05 19:01:15.758122 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.758101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-64mxw" Aug 05 19:01:15.764974 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.764944 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b065af_4c2e_43b1_850a_624bac4ee609.slice/crio-347cd4dfd3a98dc34107f876261374b067a0037ddad0b56cfabf13e20b60ac7d WatchSource:0}: Error finding container 347cd4dfd3a98dc34107f876261374b067a0037ddad0b56cfabf13e20b60ac7d: Status 404 returned error can't find the container with id 347cd4dfd3a98dc34107f876261374b067a0037ddad0b56cfabf13e20b60ac7d Aug 05 19:01:15.768484 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.768456 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0e56e0_d8f4_4537_91b2_97035dbbc26e.slice/crio-b8ce59a93b456cf0221a5a98ae4047595dd1725595d76f9ae1c2ba55f476f21b WatchSource:0}: Error finding container b8ce59a93b456cf0221a5a98ae4047595dd1725595d76f9ae1c2ba55f476f21b: Status 404 returned error can't find the container with id b8ce59a93b456cf0221a5a98ae4047595dd1725595d76f9ae1c2ba55f476f21b Aug 05 19:01:15.794986 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.794949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nzl76" Aug 05 19:01:15.803592 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.803571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lxpxw" Aug 05 19:01:15.805509 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.805479 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90798647_ba8c_4c35_9b74_4daf31a0e798.slice/crio-311905e59ce73f23dbf4545daf32a736833633872e0a45f3db62219b77af7ce7 WatchSource:0}: Error finding container 311905e59ce73f23dbf4545daf32a736833633872e0a45f3db62219b77af7ce7: Status 404 returned error can't find the container with id 311905e59ce73f23dbf4545daf32a736833633872e0a45f3db62219b77af7ce7 Aug 05 19:01:15.810463 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.810436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" Aug 05 19:01:15.813022 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.812991 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d5b716_1f71_49c2_b967_4a71c37023a7.slice/crio-4e5da2d5b2e177e8fb4a07ad017adaafefe0aa74a110fe8eaad9b84b711ecdbc WatchSource:0}: Error finding container 4e5da2d5b2e177e8fb4a07ad017adaafefe0aa74a110fe8eaad9b84b711ecdbc: Status 404 returned error can't find the container with id 4e5da2d5b2e177e8fb4a07ad017adaafefe0aa74a110fe8eaad9b84b711ecdbc Aug 05 19:01:15.814972 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.814953 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 19:01:15.820473 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.820443 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15840901_259a_4fd6_9a1d_501f989876e7.slice/crio-323b752f3304ff3e729fbb73ff35725b97440f87e0e71467dd61a3a289d5297a WatchSource:0}: Error finding container 323b752f3304ff3e729fbb73ff35725b97440f87e0e71467dd61a3a289d5297a: Status 404 returned error can't find the container with id 323b752f3304ff3e729fbb73ff35725b97440f87e0e71467dd61a3a289d5297a Aug 05 19:01:15.832028 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.832000 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j9m66" Aug 05 19:01:15.838587 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.838562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4n6rc" Aug 05 19:01:15.842939 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.842906 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b682b2_bedb_4dbf_a585_50cccff11ef4.slice/crio-6716d07cf348aecdcc48f38a95a256e2c7896b7981897a7a4831b2a79bd6d32b WatchSource:0}: Error finding container 6716d07cf348aecdcc48f38a95a256e2c7896b7981897a7a4831b2a79bd6d32b: Status 404 returned error can't find the container with id 6716d07cf348aecdcc48f38a95a256e2c7896b7981897a7a4831b2a79bd6d32b Aug 05 19:01:15.848326 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:15.848298 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832f67d7_7e03_4676_99ba_c36f8a94d0fe.slice/crio-6c5066a2a9be64749ccfd445f53298a03027aba3d3d07ec2e3d1c569ed174886 WatchSource:0}: Error finding container 6c5066a2a9be64749ccfd445f53298a03027aba3d3d07ec2e3d1c569ed174886: Status 404 returned error can't find the container with id 6c5066a2a9be64749ccfd445f53298a03027aba3d3d07ec2e3d1c569ed174886 Aug 05 19:01:15.965543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:15.965503 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 19:01:16.113358 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.113325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:16.113587 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.113390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:16.113587 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:16.113502 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:16.113587 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:16.113541 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:16.113587 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:16.113577 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret podName:6d01c6b1-66c2-42ea-aa85-82e940e1cd30 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:17.113556168 +0000 UTC m=+3.133619196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret") pod "global-pull-secret-syncer-fdhbz" (UID: "6d01c6b1-66c2-42ea-aa85-82e940e1cd30") : object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:16.113812 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:16.113619 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs podName:d81923d9-f4de-436a-a04e-b6276d577090 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:17.113589087 +0000 UTC m=+3.133652116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs") pod "network-metrics-daemon-g727w" (UID: "d81923d9-f4de-436a-a04e-b6276d577090") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:16.214589 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.214542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:16.214803 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:16.214735 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 19:01:16.214803 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:16.214777 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 19:01:16.214803 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:16.214791 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lk6rl for pod openshift-network-diagnostics/network-check-target-njw24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:16.215067 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:16.214868 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl podName:ea1dfe1a-3cef-4843-a3d7-58328cfe82a5 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:17.214845866 +0000 UTC m=+3.234908904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lk6rl" (UniqueName: "kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl") pod "network-check-target-njw24" (UID: "ea1dfe1a-3cef-4843-a3d7-58328cfe82a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:16.369084 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.368989 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 19:01:16.472835 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.472731 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 18:56:15 +0000 UTC" deadline="2028-03-26 18:25:21.544417565 +0000 UTC" Aug 05 19:01:16.472835 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.472818 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14375h24m5.071604828s" Aug 05 19:01:16.547182 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.546643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4n6rc" event={"ID":"832f67d7-7e03-4676-99ba-c36f8a94d0fe","Type":"ContainerStarted","Data":"6c5066a2a9be64749ccfd445f53298a03027aba3d3d07ec2e3d1c569ed174886"} Aug 05 19:01:16.549140 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.548959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j9m66" event={"ID":"f8b682b2-bedb-4dbf-a585-50cccff11ef4","Type":"ContainerStarted","Data":"6716d07cf348aecdcc48f38a95a256e2c7896b7981897a7a4831b2a79bd6d32b"} Aug 05 19:01:16.561662 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.561618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" event={"ID":"15840901-259a-4fd6-9a1d-501f989876e7","Type":"ContainerStarted","Data":"323b752f3304ff3e729fbb73ff35725b97440f87e0e71467dd61a3a289d5297a"} Aug 05 19:01:16.569445 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.569401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lxpxw" event={"ID":"89d5b716-1f71-49c2-b967-4a71c37023a7","Type":"ContainerStarted","Data":"4e5da2d5b2e177e8fb4a07ad017adaafefe0aa74a110fe8eaad9b84b711ecdbc"} Aug 05 19:01:16.575738 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.575204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzl76" event={"ID":"90798647-ba8c-4c35-9b74-4daf31a0e798","Type":"ContainerStarted","Data":"311905e59ce73f23dbf4545daf32a736833633872e0a45f3db62219b77af7ce7"} Aug 05 19:01:16.578683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.578649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"4f74553f85d8fc27f91619622cb6ebc28dd4f86da8dbe0846bdb0e4aa07752a0"} Aug 05 19:01:16.583333 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.583268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" event={"ID":"12cbc8a05d620b6aab5e8ac03ce312fa","Type":"ContainerStarted","Data":"bc322f2dc181a3cc119e76132b49a16adede3692145efc380cd0a023026e87ef"} Aug 05 19:01:16.589242 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.589204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-64mxw" event={"ID":"5c0e56e0-d8f4-4537-91b2-97035dbbc26e","Type":"ContainerStarted","Data":"b8ce59a93b456cf0221a5a98ae4047595dd1725595d76f9ae1c2ba55f476f21b"} Aug 05 19:01:16.600508 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.600462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" event={"ID":"b5b065af-4c2e-43b1-850a-624bac4ee609","Type":"ContainerStarted","Data":"347cd4dfd3a98dc34107f876261374b067a0037ddad0b56cfabf13e20b60ac7d"} Aug 05 19:01:16.605311 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.605274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g85lw" event={"ID":"a1143878-16e2-46b6-b88f-57c719b461e0","Type":"ContainerStarted","Data":"48d57f1c2ff502ebe10b681de7a8b25ad955cefbc598fc38f901c6e4ad58846d"} Aug 05 19:01:16.610141 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:16.610107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" event={"ID":"9a2d9cdea45beecb0aa22f28a26b4ee8","Type":"ContainerStarted","Data":"7928fb17a4e7ca95b1dced36e47ee85a61ce2c417dbc6d8358dc7aa2e14e81a2"} Aug 05 19:01:17.124342 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.124292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:17.124543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.124369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:17.124628 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.124537 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:17.124628 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.124614 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs podName:d81923d9-f4de-436a-a04e-b6276d577090 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:19.12459314 +0000 UTC m=+5.144656184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs") pod "network-metrics-daemon-g727w" (UID: "d81923d9-f4de-436a-a04e-b6276d577090") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:17.125102 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.125078 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:17.125222 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.125147 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret podName:6d01c6b1-66c2-42ea-aa85-82e940e1cd30 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:19.125130419 +0000 UTC m=+5.145193450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret") pod "global-pull-secret-syncer-fdhbz" (UID: "6d01c6b1-66c2-42ea-aa85-82e940e1cd30") : object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:17.225877 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.225086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:17.225877 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.225355 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 19:01:17.225877 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.225382 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 19:01:17.225877 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.225395 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lk6rl for pod openshift-network-diagnostics/network-check-target-njw24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:17.225877 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.225461 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl podName:ea1dfe1a-3cef-4843-a3d7-58328cfe82a5 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:19.225440813 +0000 UTC m=+5.245503842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lk6rl" (UniqueName: "kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl") pod "network-check-target-njw24" (UID: "ea1dfe1a-3cef-4843-a3d7-58328cfe82a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:17.296858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.296133 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 19:01:17.473428 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.473265 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 18:56:15 +0000 UTC" deadline="2028-04-22 01:22:18.095543708 +0000 UTC" Aug 05 19:01:17.473428 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.473339 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15006h21m0.622209752s" Aug 05 19:01:17.532207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.532164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:17.532395 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.532321 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:17.532854 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.532806 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:17.532972 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.532949 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:17.533049 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:17.533031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:17.533120 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:17.533101 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:19.145565 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:19.145521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:19.146089 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:19.145586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:19.146089 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.145697 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:19.146089 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.145781 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret podName:6d01c6b1-66c2-42ea-aa85-82e940e1cd30 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:23.145745279 +0000 UTC m=+9.165808327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret") pod "global-pull-secret-syncer-fdhbz" (UID: "6d01c6b1-66c2-42ea-aa85-82e940e1cd30") : object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:19.146274 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.145695 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:19.146274 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.146160 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs podName:d81923d9-f4de-436a-a04e-b6276d577090 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:23.146140139 +0000 UTC m=+9.166203183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs") pod "network-metrics-daemon-g727w" (UID: "d81923d9-f4de-436a-a04e-b6276d577090") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:19.246974 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:19.246785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:19.247111 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.247030 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 19:01:19.247111 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.247061 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 19:01:19.247111 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.247076 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lk6rl for pod openshift-network-diagnostics/network-check-target-njw24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:19.247249 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.247155 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl podName:ea1dfe1a-3cef-4843-a3d7-58328cfe82a5 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:23.247130181 +0000 UTC m=+9.267193234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lk6rl" (UniqueName: "kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl") pod "network-check-target-njw24" (UID: "ea1dfe1a-3cef-4843-a3d7-58328cfe82a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:19.532212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:19.532112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:19.532212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:19.532167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:19.532457 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.532280 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:19.532457 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.532387 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:19.532457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:19.532449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:19.532587 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:19.532521 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:21.532319 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:21.532276 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:21.532319 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:21.532313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:21.532869 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:21.532285 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:21.532869 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:21.532400 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:21.532869 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:21.532467 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:21.532869 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:21.532513 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:23.180435 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:23.180196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:23.180435 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:23.180267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:23.180435 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.180389 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:23.181029 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.180463 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret podName:6d01c6b1-66c2-42ea-aa85-82e940e1cd30 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:31.180443027 +0000 UTC m=+17.200506058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret") pod "global-pull-secret-syncer-fdhbz" (UID: "6d01c6b1-66c2-42ea-aa85-82e940e1cd30") : object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:23.181029 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.180394 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:23.181029 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.180894 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs podName:d81923d9-f4de-436a-a04e-b6276d577090 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:31.180875409 +0000 UTC m=+17.200938435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs") pod "network-metrics-daemon-g727w" (UID: "d81923d9-f4de-436a-a04e-b6276d577090") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:23.281523 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:23.281433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:23.281687 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.281595 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 19:01:23.281687 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.281614 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 19:01:23.281687 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.281627 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lk6rl for pod openshift-network-diagnostics/network-check-target-njw24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:23.281872 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.281690 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl podName:ea1dfe1a-3cef-4843-a3d7-58328cfe82a5 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:31.281668861 +0000 UTC m=+17.301731901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lk6rl" (UniqueName: "kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl") pod "network-check-target-njw24" (UID: "ea1dfe1a-3cef-4843-a3d7-58328cfe82a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:23.532258 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:23.532178 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:23.532423 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.532320 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:23.532501 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:23.532473 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:23.532630 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.532598 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:23.532702 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:23.532631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:23.532782 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:23.532705 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:25.532048 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:25.531993 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:25.532048 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:25.532046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:25.532566 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:25.531993 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:25.532566 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:25.532127 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:25.532566 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:25.532276 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:25.532566 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:25.532356 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:27.532181 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:27.531649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:27.532181 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:27.531681 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:27.532181 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:27.531681 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:27.532181 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:27.531812 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:27.532181 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:27.531909 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:27.532181 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:27.532004 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:29.532232 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:29.532185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:29.532232 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:29.532226 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:29.532232 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:29.532234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:29.532778 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:29.532323 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:29.532778 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:29.532428 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:29.532778 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:29.532493 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:31.245649 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:31.245605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:31.245649 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:31.245654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:31.246077 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.245769 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:31.246077 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.245836 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret podName:6d01c6b1-66c2-42ea-aa85-82e940e1cd30 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:47.245822117 +0000 UTC m=+33.265885143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret") pod "global-pull-secret-syncer-fdhbz" (UID: "6d01c6b1-66c2-42ea-aa85-82e940e1cd30") : object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:31.246077 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.245778 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:31.246077 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.245911 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs podName:d81923d9-f4de-436a-a04e-b6276d577090 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:47.245897475 +0000 UTC m=+33.265960501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs") pod "network-metrics-daemon-g727w" (UID: "d81923d9-f4de-436a-a04e-b6276d577090") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:31.346481 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:31.346439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:31.346643 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.346607 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 19:01:31.346643 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.346625 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 19:01:31.346643 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.346636 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lk6rl for pod openshift-network-diagnostics/network-check-target-njw24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:31.346793 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.346702 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl podName:ea1dfe1a-3cef-4843-a3d7-58328cfe82a5 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:47.346682854 +0000 UTC m=+33.366745899 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lk6rl" (UniqueName: "kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl") pod "network-check-target-njw24" (UID: "ea1dfe1a-3cef-4843-a3d7-58328cfe82a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:31.532044 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:31.531958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:31.532044 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:31.531979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:31.532044 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:31.531953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:31.532327 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.532102 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:31.532327 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.532209 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:31.532327 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:31.532283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:33.531635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:33.531420 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:33.532162 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:33.531442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:33.532162 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:33.531741 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:33.532162 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:33.531450 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:33.532162 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:33.531799 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:33.532162 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:33.531901 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:35.532071 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.532038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:35.532452 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.532074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:35.532452 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.532074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:35.532452 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:35.532141 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:35.532452 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:35.532237 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:35.532452 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:35.532306 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:35.655429 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.655390 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" event={"ID":"12cbc8a05d620b6aab5e8ac03ce312fa","Type":"ContainerStarted","Data":"c1d02a35957d93ab787e4100b8fadc998949b28cea1bb33496792641e2788d68"} Aug 05 19:01:35.657249 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.657220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" event={"ID":"b5b065af-4c2e-43b1-850a-624bac4ee609","Type":"ContainerStarted","Data":"aded19204416cfa742604fd24dfbb2f7167aa168e4fc74a3807c0e26d9461a3f"} Aug 05 19:01:35.658929 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.658875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4n6rc" event={"ID":"832f67d7-7e03-4676-99ba-c36f8a94d0fe","Type":"ContainerStarted","Data":"6503c4dcd373a55f65f65fff90aa76931d8888920cd0b5cf4923bd5857f4e09a"} Aug 05 19:01:35.670420 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.670337 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-134.ec2.internal" podStartSLOduration=20.670317978 podStartE2EDuration="20.670317978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:35.669775037 +0000 UTC m=+21.689838079" watchObservedRunningTime="2026-08-05 19:01:35.670317978 +0000 UTC m=+21.690381026" Aug 05 19:01:35.684711 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.684639 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4n6rc" podStartSLOduration=1.307390296 podStartE2EDuration="20.684621308s" totalImagesPullingTime="19.377231012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:35.684473568 +0000 UTC m=+21.704536616" watchObservedRunningTime="2026-08-05 19:01:35.684621308 +0000 UTC m=+21.704684355" Aug 05 19:01:35.699254 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:35.699200 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gw7hk" podStartSLOduration=1.2710824600000001 podStartE2EDuration="20.699181404s" totalImagesPullingTime="19.428098944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:35.698650632 +0000 UTC m=+21.718713679" watchObservedRunningTime="2026-08-05 19:01:35.699181404 +0000 UTC m=+21.719244452" Aug 05 19:01:36.664126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.663828 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j9m66" event={"ID":"f8b682b2-bedb-4dbf-a585-50cccff11ef4","Type":"ContainerStarted","Data":"f7a2b5f6c95b9d17e116d4b21e6917a080ad56c498cd3cde984b2d7424b4fb6c"} Aug 05 19:01:36.665534 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.665510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" event={"ID":"15840901-259a-4fd6-9a1d-501f989876e7","Type":"ContainerStarted","Data":"c6f6ea180a0c1bd0ce5943777bef4d7bbcb3b64062375c12d5fdffea1fac68e9"} Aug 05 19:01:36.667501 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.667447 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lxpxw" event={"ID":"89d5b716-1f71-49c2-b967-4a71c37023a7","Type":"ContainerStarted","Data":"2b6ac671ad4c7318b2be8c279088725948179d7a2bc2bc5e1af3f02615a42f51"} Aug 05 19:01:36.669671 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.669644 2578 generic.go:356] "Generic (PLEG): container finished" podID="90798647-ba8c-4c35-9b74-4daf31a0e798" containerID="5a74f2960f34076e3a414b7dc393f3e3538a24315d88861b28e8a047ff85bcca" exitCode=0 Aug 05 19:01:36.669808 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.669713 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzl76" event={"ID":"90798647-ba8c-4c35-9b74-4daf31a0e798","Type":"ContainerDied","Data":"5a74f2960f34076e3a414b7dc393f3e3538a24315d88861b28e8a047ff85bcca"} Aug 05 19:01:36.673924 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.673898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"bffded7c0a727fdfa6f5bfe97b3ed182063a38d0ae5ad74d933060d016def57f"} Aug 05 19:01:36.674026 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.673973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"d63f07e85adb900a4f29708592d9b637899c3691d05739b58d58797f0ffae8c1"} Aug 05 19:01:36.674026 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.674023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"65502c4a969bf6bcbcd0e2e3ed14978120627e74313dc98f55369938530a624b"} Aug 05 19:01:36.674133 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.674058 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"5647f6bf22fd4e893279b9a2590f7f2efc0eb9dbecdca5eac993c2c3de563aa9"} Aug 05 19:01:36.674196 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.674146 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"6fc90b2cbac5769d64cc60def173ec17e8a59c108d829b7d088b69abb3eb0a2e"} Aug 05 19:01:36.674196 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.674183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"0db7082aadbd3080891deeb642f19b095015c21d39d7ef8a33f0ae6e0fbd0c40"} Aug 05 19:01:36.675957 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.675932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-64mxw" event={"ID":"5c0e56e0-d8f4-4537-91b2-97035dbbc26e","Type":"ContainerStarted","Data":"2e6eccc2e8d7aec1a3b6de38b286ec7bfc6b66276d4692337ae6f370d1d3f50b"} Aug 05 19:01:36.677563 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.677538 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g85lw" event={"ID":"a1143878-16e2-46b6-b88f-57c719b461e0","Type":"ContainerStarted","Data":"eb94d23d2b52e4f5b04d9245494f0935fd6537aa8d9d1aab25c64bd445f10658"} Aug 05 19:01:36.679281 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.679168 2578 generic.go:356] "Generic (PLEG): container finished" podID="9a2d9cdea45beecb0aa22f28a26b4ee8" containerID="a2ccbca625c995873d8ac30dcea7ed9a0df942907aae3d217423c28bfe48d457" exitCode=0 Aug 05 19:01:36.679281 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.679237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" event={"ID":"9a2d9cdea45beecb0aa22f28a26b4ee8","Type":"ContainerDied","Data":"a2ccbca625c995873d8ac30dcea7ed9a0df942907aae3d217423c28bfe48d457"} Aug 05 19:01:36.694515 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.694464 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j9m66" podStartSLOduration=2.3629257 podStartE2EDuration="21.694444077s" totalImagesPullingTime="19.331518377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:36.679145295 +0000 UTC m=+22.699208344" watchObservedRunningTime="2026-08-05 19:01:36.694444077 +0000 UTC m=+22.714507126" Aug 05 19:01:36.694998 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.694971 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g85lw" podStartSLOduration=2.259147666 podStartE2EDuration="21.694962235s" totalImagesPullingTime="19.435814569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:36.694295736 +0000 UTC m=+22.714358783" watchObservedRunningTime="2026-08-05 19:01:36.694962235 +0000 UTC m=+22.715025284" Aug 05 19:01:36.709001 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.708951 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-64mxw" podStartSLOduration=11.246975545 podStartE2EDuration="21.708929462s" totalImagesPullingTime="10.461953917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:36.708132207 +0000 UTC m=+22.728195254" watchObservedRunningTime="2026-08-05 19:01:36.708929462 +0000 UTC m=+22.728992512" Aug 05 19:01:36.752307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:36.752246 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lxpxw" podStartSLOduration=2.390994692 podStartE2EDuration="21.752222285s" totalImagesPullingTime="19.361227593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:36.752004566 +0000 UTC m=+22.772067614" watchObservedRunningTime="2026-08-05 19:01:36.752222285 +0000 UTC m=+22.772285334" Aug 05 19:01:37.532019 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:37.531961 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:37.532282 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:37.532091 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:37.532282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:37.532097 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:37.532282 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:37.532184 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:37.532282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:37.532205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:37.532282 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:37.532277 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:37.572580 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:37.572525 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 05 19:01:37.683762 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:37.683656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" event={"ID":"15840901-259a-4fd6-9a1d-501f989876e7","Type":"ContainerStarted","Data":"a6d622d83d74580756cbcd7bc723551c2c44eba2b706a68993788fce09c29aca"} Aug 05 19:01:37.685634 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:37.685590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" event={"ID":"9a2d9cdea45beecb0aa22f28a26b4ee8","Type":"ContainerStarted","Data":"179281c1f0b5bf4b7dd2d066260bac3219854ee5e28897bd4d5799c9c3afa061"} Aug 05 19:01:37.699225 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:37.699176 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-134.ec2.internal" podStartSLOduration=22.699159795 podStartE2EDuration="22.699159795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:37.699127191 +0000 UTC m=+23.719190241" watchObservedRunningTime="2026-08-05 19:01:37.699159795 +0000 UTC m=+23.719222836" Aug 05 19:01:38.481718 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:38.481549 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T19:01:37.572545475Z","UUID":"c816d86b-e6c4-4a79-8855-769c6312dfd3","Handler":null,"Name":"","Endpoint":""} Aug 05 19:01:38.483294 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:38.483271 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 05 19:01:38.483427 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:38.483315 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 05 19:01:39.531937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:39.531900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:39.532392 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:39.531955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:39.532392 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:39.531900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:39.532392 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:39.532038 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:39.532392 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:39.532122 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:39.532392 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:39.532188 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:39.695359 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:39.695321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" event={"ID":"15840901-259a-4fd6-9a1d-501f989876e7","Type":"ContainerStarted","Data":"35fb42769cb98cb99ee47d3092b0e11d869cc232cc292edd9aa5902422fbc61a"} Aug 05 19:01:39.699301 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:39.699269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"e499f67fe90ccf44a7b0ec6e01a0d10f88d8ea03add0fa348d85e92177ba050e"} Aug 05 19:01:40.365992 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:40.365958 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:40.366670 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:40.366648 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:40.380965 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:40.380905 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9z6h" podStartSLOduration=3.242934682 podStartE2EDuration="25.380882553s" totalImagesPullingTime="22.137947871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:39.711705078 +0000 UTC m=+25.731768127" watchObservedRunningTime="2026-08-05 19:01:40.380882553 +0000 UTC m=+26.400945603" Aug 05 19:01:40.701956 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:40.701873 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:40.702382 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:40.702255 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g85lw" Aug 05 19:01:41.531600 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:41.531403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:41.531777 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:41.531444 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:41.531777 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:41.531687 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:41.531918 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:41.531786 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:41.531918 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:41.531444 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:41.532014 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:41.531941 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:41.705785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:41.705738 2578 generic.go:356] "Generic (PLEG): container finished" podID="90798647-ba8c-4c35-9b74-4daf31a0e798" containerID="dd58fa5da2ab3fc6050a3be8ce0aae869a9dfd70549a3473a646208d1f6b9c5b" exitCode=0 Aug 05 19:01:41.706639 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:41.705785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzl76" event={"ID":"90798647-ba8c-4c35-9b74-4daf31a0e798","Type":"ContainerDied","Data":"dd58fa5da2ab3fc6050a3be8ce0aae869a9dfd70549a3473a646208d1f6b9c5b"} Aug 05 19:01:41.709767 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:41.709721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" event={"ID":"eb91555c-4f92-4e92-91da-483dcf02fe2d","Type":"ContainerStarted","Data":"519f6648db2c532cfabccd3253c9f1c8bcbe2f0b2780d9b96eeb5c5aae4c09ac"} Aug 05 19:01:41.754273 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:41.754159 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" podStartSLOduration=6.615849144 podStartE2EDuration="26.754144386s" totalImagesPullingTime="20.138295242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:41.752902162 +0000 UTC m=+27.772965210" watchObservedRunningTime="2026-08-05 19:01:41.754144386 +0000 UTC m=+27.774207434" Aug 05 19:01:42.712350 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:42.712087 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:42.712936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:42.712403 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:42.712936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:42.712452 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:42.728057 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:42.728033 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:42.728198 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:42.728132 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:01:43.532189 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.532153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:43.532363 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.532157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:43.532363 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:43.532257 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:43.532363 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.532165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:43.532468 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:43.532332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:43.532468 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:43.532445 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:43.558213 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.558177 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdhbz"] Aug 05 19:01:43.560793 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.560762 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-njw24"] Aug 05 19:01:43.572472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.572437 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g727w"] Aug 05 19:01:43.716459 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.716425 2578 generic.go:356] "Generic (PLEG): container finished" podID="90798647-ba8c-4c35-9b74-4daf31a0e798" containerID="d0fb397846b2ae2e2555e995e187fcb8b6ff8faeb8f0973f99e3c9bba7c96670" exitCode=0 Aug 05 19:01:43.716935 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.716507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:43.716935 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.716537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzl76" event={"ID":"90798647-ba8c-4c35-9b74-4daf31a0e798","Type":"ContainerDied","Data":"d0fb397846b2ae2e2555e995e187fcb8b6ff8faeb8f0973f99e3c9bba7c96670"} Aug 05 19:01:43.716935 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:43.716657 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:43.716935 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.716684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:43.716935 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:43.716794 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:43.716935 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:43.716913 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:43.717197 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:43.716986 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:44.722086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:44.721991 2578 generic.go:356] "Generic (PLEG): container finished" podID="90798647-ba8c-4c35-9b74-4daf31a0e798" containerID="0765b345c6529addc6dd84a51b9c32bfe848eea94b8453a78f93982705cd7d80" exitCode=0 Aug 05 19:01:44.722596 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:44.722082 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzl76" event={"ID":"90798647-ba8c-4c35-9b74-4daf31a0e798","Type":"ContainerDied","Data":"0765b345c6529addc6dd84a51b9c32bfe848eea94b8453a78f93982705cd7d80"} Aug 05 19:01:45.531864 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:45.531829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:45.532020 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:45.531870 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:45.532020 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:45.531973 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:45.532147 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:45.532041 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:45.532147 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:45.532102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:45.532250 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:45.532175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:47.261605 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:47.261519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:47.262175 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:47.261713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:47.262175 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.261735 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:47.262175 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.261833 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs podName:d81923d9-f4de-436a-a04e-b6276d577090 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:19.261811788 +0000 UTC m=+65.281874828 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs") pod "network-metrics-daemon-g727w" (UID: "d81923d9-f4de-436a-a04e-b6276d577090") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 19:01:47.262175 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.261859 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:47.262175 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.261919 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret podName:6d01c6b1-66c2-42ea-aa85-82e940e1cd30 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:19.261901047 +0000 UTC m=+65.281964077 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret") pod "global-pull-secret-syncer-fdhbz" (UID: "6d01c6b1-66c2-42ea-aa85-82e940e1cd30") : object "kube-system"/"original-pull-secret" not registered Aug 05 19:01:47.362738 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:47.362696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:47.362928 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.362851 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 19:01:47.362928 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.362866 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 19:01:47.362928 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.362876 2578 projected.go:196] Error preparing data for projected volume kube-api-access-lk6rl for pod openshift-network-diagnostics/network-check-target-njw24: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:47.362928 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.362924 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl podName:ea1dfe1a-3cef-4843-a3d7-58328cfe82a5 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:19.362911434 +0000 UTC m=+65.382974459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lk6rl" (UniqueName: "kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl") pod "network-check-target-njw24" (UID: "ea1dfe1a-3cef-4843-a3d7-58328cfe82a5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 19:01:47.532374 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:47.532268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:47.532374 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:47.532268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:47.532607 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.532417 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g727w" podUID="d81923d9-f4de-436a-a04e-b6276d577090" Aug 05 19:01:47.532607 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:47.532268 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:47.532607 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.532461 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdhbz" podUID="6d01c6b1-66c2-42ea-aa85-82e940e1cd30" Aug 05 19:01:47.532607 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:47.532526 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njw24" podUID="ea1dfe1a-3cef-4843-a3d7-58328cfe82a5" Aug 05 19:01:48.290301 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.290268 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-134.ec2.internal" event="NodeReady" Aug 05 19:01:48.290729 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.290417 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 05 19:01:48.323810 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.323772 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-777fff4966-bxbgm"] Aug 05 19:01:48.327198 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.327174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.331153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.331015 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zb2vm\"" Aug 05 19:01:48.331153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.331034 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 05 19:01:48.331918 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.331890 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 05 19:01:48.332036 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.331924 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 05 19:01:48.337919 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.337893 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qmmbg"] Aug 05 19:01:48.338316 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.338295 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 05 19:01:48.344808 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.344773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.346665 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.346641 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6fj2w"] Aug 05 19:01:48.347448 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.347425 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6qmv\"" Aug 05 19:01:48.347663 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.347646 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 05 19:01:48.347758 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.347696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 05 19:01:48.349580 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.349556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777fff4966-bxbgm"] Aug 05 19:01:48.349689 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.349598 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qmmbg"] Aug 05 19:01:48.349771 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.349730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6fj2w" Aug 05 19:01:48.352462 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.352440 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 05 19:01:48.352604 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.352584 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 05 19:01:48.352734 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.352716 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s6kl2\"" Aug 05 19:01:48.353859 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.353834 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 05 19:01:48.357378 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.357356 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6fj2w"] Aug 05 19:01:48.472614 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dht6v\" (UniqueName: \"kubernetes.io/projected/d9333206-a382-40f1-90ef-bfda175ba53d-kube-api-access-dht6v\") pod \"ingress-canary-6fj2w\" (UID: \"d9333206-a382-40f1-90ef-bfda175ba53d\") " pod="openshift-ingress-canary/ingress-canary-6fj2w" Aug 05 19:01:48.472614 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.472614 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d48840be-5068-46be-aa12-0ea789eb0a66-tmp-dir\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.472906 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-image-registry-private-configuration\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.472906 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.472906 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35699ceb-76c2-4a58-b5a2-abde7236b151-ca-trust-extracted\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.472906 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-certificates\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.472906 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-trusted-ca\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.472906 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9333206-a382-40f1-90ef-bfda175ba53d-cert\") pod \"ingress-canary-6fj2w\" (UID: \"d9333206-a382-40f1-90ef-bfda175ba53d\") " pod="openshift-ingress-canary/ingress-canary-6fj2w" Aug 05 19:01:48.473162 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.472935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dljfz\" (UniqueName: \"kubernetes.io/projected/d48840be-5068-46be-aa12-0ea789eb0a66-kube-api-access-dljfz\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.473162 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.473003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-installation-pull-secrets\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.473162 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.473024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdg2\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-kube-api-access-dtdg2\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.473162 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.473145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-bound-sa-token\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.473371 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.473181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d48840be-5068-46be-aa12-0ea789eb0a66-config-volume\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.574013 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.573975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.574013 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35699ceb-76c2-4a58-b5a2-abde7236b151-ca-trust-extracted\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.574252 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-certificates\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.574252 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-trusted-ca\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.574252 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9333206-a382-40f1-90ef-bfda175ba53d-cert\") pod \"ingress-canary-6fj2w\" (UID: \"d9333206-a382-40f1-90ef-bfda175ba53d\") " pod="openshift-ingress-canary/ingress-canary-6fj2w" Aug 05 19:01:48.574252 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dljfz\" (UniqueName: \"kubernetes.io/projected/d48840be-5068-46be-aa12-0ea789eb0a66-kube-api-access-dljfz\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.574252 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:48.574142 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 19:01:48.574252 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:48.574160 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777fff4966-bxbgm: secret "image-registry-tls" not found Aug 05 19:01:48.574252 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-installation-pull-secrets\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.574252 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:48.574233 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls podName:35699ceb-76c2-4a58-b5a2-abde7236b151 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:49.074212441 +0000 UTC m=+35.094275487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls") pod "image-registry-777fff4966-bxbgm" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151") : secret "image-registry-tls" not found Aug 05 19:01:48.574630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdg2\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-kube-api-access-dtdg2\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.574630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-bound-sa-token\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.574630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d48840be-5068-46be-aa12-0ea789eb0a66-config-volume\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.574630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dht6v\" (UniqueName: \"kubernetes.io/projected/d9333206-a382-40f1-90ef-bfda175ba53d-kube-api-access-dht6v\") pod \"ingress-canary-6fj2w\" (UID: \"d9333206-a382-40f1-90ef-bfda175ba53d\") " pod="openshift-ingress-canary/ingress-canary-6fj2w" Aug 05 19:01:48.574630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.574630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d48840be-5068-46be-aa12-0ea789eb0a66-tmp-dir\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.574630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-image-registry-private-configuration\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.574630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.574531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35699ceb-76c2-4a58-b5a2-abde7236b151-ca-trust-extracted\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.575025 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:48.574975 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 19:01:48.575082 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:48.575036 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls podName:d48840be-5068-46be-aa12-0ea789eb0a66 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:49.075018975 +0000 UTC m=+35.095082007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls") pod "dns-default-qmmbg" (UID: "d48840be-5068-46be-aa12-0ea789eb0a66") : secret "dns-default-metrics-tls" not found Aug 05 19:01:48.575082 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.575062 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-certificates\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.575328 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.575304 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d48840be-5068-46be-aa12-0ea789eb0a66-config-volume\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.575328 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.575319 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d48840be-5068-46be-aa12-0ea789eb0a66-tmp-dir\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.575585 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.575567 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-trusted-ca\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.578645 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.578543 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-image-registry-private-configuration\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.578742 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.578552 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9333206-a382-40f1-90ef-bfda175ba53d-cert\") pod \"ingress-canary-6fj2w\" (UID: \"d9333206-a382-40f1-90ef-bfda175ba53d\") " pod="openshift-ingress-canary/ingress-canary-6fj2w" Aug 05 19:01:48.578742 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.578596 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-installation-pull-secrets\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.582545 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.582518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dljfz\" (UniqueName: \"kubernetes.io/projected/d48840be-5068-46be-aa12-0ea789eb0a66-kube-api-access-dljfz\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:48.583557 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.583399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdg2\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-kube-api-access-dtdg2\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.583557 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.583541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dht6v\" (UniqueName: \"kubernetes.io/projected/d9333206-a382-40f1-90ef-bfda175ba53d-kube-api-access-dht6v\") pod \"ingress-canary-6fj2w\" (UID: \"d9333206-a382-40f1-90ef-bfda175ba53d\") " pod="openshift-ingress-canary/ingress-canary-6fj2w" Aug 05 19:01:48.583864 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.583841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-bound-sa-token\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:48.665212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:48.665167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6fj2w" Aug 05 19:01:49.078881 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.078843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:49.079114 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.078901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:49.079114 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:49.079014 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 19:01:49.079114 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:49.079043 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777fff4966-bxbgm: secret "image-registry-tls" not found Aug 05 19:01:49.079114 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:49.079106 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls podName:35699ceb-76c2-4a58-b5a2-abde7236b151 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:50.079085715 +0000 UTC m=+36.099148740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls") pod "image-registry-777fff4966-bxbgm" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151") : secret "image-registry-tls" not found Aug 05 19:01:49.079114 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:49.079012 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 19:01:49.079314 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:49.079148 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls podName:d48840be-5068-46be-aa12-0ea789eb0a66 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:50.079135792 +0000 UTC m=+36.099198827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls") pod "dns-default-qmmbg" (UID: "d48840be-5068-46be-aa12-0ea789eb0a66") : secret "dns-default-metrics-tls" not found Aug 05 19:01:49.531651 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.531565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:01:49.532138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.531565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:01:49.532138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.531565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:01:49.534631 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.534609 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 19:01:49.535887 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.535695 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk5vf\"" Aug 05 19:01:49.535887 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.535697 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 19:01:49.535887 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.535850 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 19:01:49.535887 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.535852 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7thz\"" Aug 05 19:01:49.536163 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:49.536064 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 19:01:50.087970 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.087926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:50.088188 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.087998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:50.088188 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:50.088115 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 19:01:50.088188 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:50.088130 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 19:01:50.088188 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:50.088142 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777fff4966-bxbgm: secret "image-registry-tls" not found Aug 05 19:01:50.088398 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:50.088203 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls podName:35699ceb-76c2-4a58-b5a2-abde7236b151 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:52.088181404 +0000 UTC m=+38.108244449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls") pod "image-registry-777fff4966-bxbgm" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151") : secret "image-registry-tls" not found Aug 05 19:01:50.088398 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:50.088220 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls podName:d48840be-5068-46be-aa12-0ea789eb0a66 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:52.08821112 +0000 UTC m=+38.108274146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls") pod "dns-default-qmmbg" (UID: "d48840be-5068-46be-aa12-0ea789eb0a66") : secret "dns-default-metrics-tls" not found Aug 05 19:01:50.340813 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.340730 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6fj2w"] Aug 05 19:01:50.419100 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:50.419060 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9333206_a382_40f1_90ef_bfda175ba53d.slice/crio-7b57696edd3d8227178ce1de3463357b8772d4675eabb4c9f49a638f1cc31931 WatchSource:0}: Error finding container 7b57696edd3d8227178ce1de3463357b8772d4675eabb4c9f49a638f1cc31931: Status 404 returned error can't find the container with id 7b57696edd3d8227178ce1de3463357b8772d4675eabb4c9f49a638f1cc31931 Aug 05 19:01:50.737168 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.737124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6fj2w" event={"ID":"d9333206-a382-40f1-90ef-bfda175ba53d","Type":"ContainerStarted","Data":"7b57696edd3d8227178ce1de3463357b8772d4675eabb4c9f49a638f1cc31931"} Aug 05 19:01:50.739847 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.739816 2578 generic.go:356] "Generic (PLEG): container finished" podID="90798647-ba8c-4c35-9b74-4daf31a0e798" containerID="55af081e3cba3eba0d7b57f9533c567e357ef5ce2a0162f425ae73ba86fa68b8" exitCode=0 Aug 05 19:01:50.739970 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.739866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzl76" event={"ID":"90798647-ba8c-4c35-9b74-4daf31a0e798","Type":"ContainerDied","Data":"55af081e3cba3eba0d7b57f9533c567e357ef5ce2a0162f425ae73ba86fa68b8"} Aug 05 19:01:50.807017 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.806977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:50.888787 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.888533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:50.989727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:50.989692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:51.746502 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:51.746464 2578 generic.go:356] "Generic (PLEG): container finished" podID="90798647-ba8c-4c35-9b74-4daf31a0e798" containerID="ab9b79e9ceab28adf5f28230256830084b9e0edf565caaa36d0be97e4b36c028" exitCode=0 Aug 05 19:01:51.746984 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:51.746532 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzl76" event={"ID":"90798647-ba8c-4c35-9b74-4daf31a0e798","Type":"ContainerDied","Data":"ab9b79e9ceab28adf5f28230256830084b9e0edf565caaa36d0be97e4b36c028"} Aug 05 19:01:52.106230 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:52.106189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:52.106406 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:52.106245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:52.106406 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:52.106343 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 19:01:52.106406 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:52.106400 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 19:01:52.106558 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:52.106411 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls podName:d48840be-5068-46be-aa12-0ea789eb0a66 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:56.106392337 +0000 UTC m=+42.126455366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls") pod "dns-default-qmmbg" (UID: "d48840be-5068-46be-aa12-0ea789eb0a66") : secret "dns-default-metrics-tls" not found Aug 05 19:01:52.106558 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:52.106416 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777fff4966-bxbgm: secret "image-registry-tls" not found Aug 05 19:01:52.106558 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:52.106456 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls podName:35699ceb-76c2-4a58-b5a2-abde7236b151 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:56.10644529 +0000 UTC m=+42.126508349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls") pod "image-registry-777fff4966-bxbgm" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151") : secret "image-registry-tls" not found Aug 05 19:01:52.756253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:52.756214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nzl76" event={"ID":"90798647-ba8c-4c35-9b74-4daf31a0e798","Type":"ContainerStarted","Data":"271146199b85bee3153d6859275ec7758984d5b0356cbc2b658d62b00f3c385d"} Aug 05 19:01:52.785939 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:52.785888 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nzl76" podStartSLOduration=5.989539217 podStartE2EDuration="37.785863671s" totalImagesPullingTime="31.796324454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:52.784113507 +0000 UTC m=+38.804176566" watchObservedRunningTime="2026-08-05 19:01:52.785863671 +0000 UTC m=+38.805926720" Aug 05 19:01:52.909453 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:52.909411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:52.975581 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:52.975543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:53.761406 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:53.761366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6fj2w" event={"ID":"d9333206-a382-40f1-90ef-bfda175ba53d","Type":"ContainerStarted","Data":"41f877afc1a5b606618e5669a5a5127b0e78e5ce2eff945d07beef956122bef9"} Aug 05 19:01:53.780042 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:53.779981 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6fj2w" podStartSLOduration=2.617992974 podStartE2EDuration="5.779965416s" totalImagesPullingTime="3.161972442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:01:53.778613915 +0000 UTC m=+39.798676976" watchObservedRunningTime="2026-08-05 19:01:53.779965416 +0000 UTC m=+39.800028496" Aug 05 19:01:53.863656 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:53.863557 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:53.965265 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:53.965229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:56.139564 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:56.139522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:01:56.140010 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:56.139577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:01:56.140010 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:56.139681 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 19:01:56.140010 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:56.139710 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 19:01:56.140010 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:56.139721 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777fff4966-bxbgm: secret "image-registry-tls" not found Aug 05 19:01:56.140010 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:56.139765 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls podName:d48840be-5068-46be-aa12-0ea789eb0a66 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:04.139732148 +0000 UTC m=+50.159795175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls") pod "dns-default-qmmbg" (UID: "d48840be-5068-46be-aa12-0ea789eb0a66") : secret "dns-default-metrics-tls" not found Aug 05 19:01:56.140010 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:56.139785 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls podName:35699ceb-76c2-4a58-b5a2-abde7236b151 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:04.139775641 +0000 UTC m=+50.159838671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls") pod "image-registry-777fff4966-bxbgm" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151") : secret "image-registry-tls" not found Aug 05 19:01:57.871588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.871552 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr"] Aug 05 19:01:57.893183 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.893143 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-kfhkc"] Aug 05 19:01:57.893331 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.893279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr" Aug 05 19:01:57.896024 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.895996 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Aug 05 19:01:57.897059 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.897031 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-86xdq\"" Aug 05 19:01:57.897546 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.897073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Aug 05 19:01:57.905108 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.905085 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr"] Aug 05 19:01:57.905210 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.905122 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-kfhkc"] Aug 05 19:01:57.905210 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.905195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:57.907765 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.907731 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Aug 05 19:01:57.907991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.907975 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 05 19:01:57.907991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.907988 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bbzdc\"" Aug 05 19:01:57.908108 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.907981 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 05 19:01:57.908108 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.908027 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Aug 05 19:01:57.913030 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.913009 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Aug 05 19:01:57.968966 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.968901 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh"] Aug 05 19:01:57.975482 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.975452 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:57.976064 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.976039 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8"] Aug 05 19:01:57.978210 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.978149 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Aug 05 19:01:57.978210 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.978205 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Aug 05 19:01:57.978478 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.978360 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Aug 05 19:01:57.978478 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.978426 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Aug 05 19:01:57.978685 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.978670 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rrnm4\"" Aug 05 19:01:57.990620 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.990588 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-mzxn4"] Aug 05 19:01:57.990813 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.990790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:57.993496 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.993474 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 05 19:01:57.993641 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.993519 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g95qw\"" Aug 05 19:01:57.994708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.994585 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 05 19:01:57.994708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.994629 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Aug 05 19:01:57.994708 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:57.994635 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Aug 05 19:01:58.005518 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.005496 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f999d9fc6-fwg8z"] Aug 05 19:01:58.005625 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.005606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.008206 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.008182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Aug 05 19:01:58.008305 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.008222 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Aug 05 19:01:58.008541 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.008527 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Aug 05 19:01:58.008649 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.008630 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wdzck\"" Aug 05 19:01:58.008721 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.008703 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Aug 05 19:01:58.016790 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.016763 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9"] Aug 05 19:01:58.017426 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.017402 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Aug 05 19:01:58.017883 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.017863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.020207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.020188 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xkdt7\"" Aug 05 19:01:58.020404 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.020388 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Aug 05 19:01:58.020774 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.020743 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Aug 05 19:01:58.020961 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.020933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Aug 05 19:01:58.021075 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.021051 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 05 19:01:58.021179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.021142 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Aug 05 19:01:58.021301 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.021287 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 05 19:01:58.028666 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.028645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh"] Aug 05 19:01:58.028774 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.028678 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9"] Aug 05 19:01:58.028774 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.028699 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8"] Aug 05 19:01:58.028774 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.028720 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-mzxn4"] Aug 05 19:01:58.028774 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.028769 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f999d9fc6-fwg8z"] Aug 05 19:01:58.028919 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.028777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9" Aug 05 19:01:58.032380 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.032365 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rxwb9\"" Aug 05 19:01:58.052614 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.052580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9s8\" (UniqueName: \"kubernetes.io/projected/fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e-kube-api-access-mv9s8\") pod \"volume-data-source-validator-5b8776669-z6xkr\" (UID: \"fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr" Aug 05 19:01:58.052766 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.052621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00857821-0bae-44c3-a656-0033cc3c0cfc-service-ca-bundle\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.052766 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.052641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00857821-0bae-44c3-a656-0033cc3c0cfc-serving-cert\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.052766 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.052711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00857821-0bae-44c3-a656-0033cc3c0cfc-tmp\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.052766 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.052758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00857821-0bae-44c3-a656-0033cc3c0cfc-snapshots\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.052942 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.052820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00857821-0bae-44c3-a656-0033cc3c0cfc-trusted-ca-bundle\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.052942 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.052839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtbjl\" (UniqueName: \"kubernetes.io/projected/00857821-0bae-44c3-a656-0033cc3c0cfc-kube-api-access-xtbjl\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.070207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.070175 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b"] Aug 05 19:01:58.085363 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.085325 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj"] Aug 05 19:01:58.085550 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.085487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.088371 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.088347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Aug 05 19:01:58.088510 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.088357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Aug 05 19:01:58.088510 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.088423 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-576dv\"" Aug 05 19:01:58.088769 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.088741 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Aug 05 19:01:58.089094 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.089076 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Aug 05 19:01:58.099895 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.099860 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-xcthw"] Aug 05 19:01:58.100043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.099999 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:01:58.103198 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.103174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 05 19:01:58.103332 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.103174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pcp72\"" Aug 05 19:01:58.103332 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.103205 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 05 19:01:58.103332 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.103207 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 05 19:01:58.110312 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.110290 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b"] Aug 05 19:01:58.110312 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.110322 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-xcthw"] Aug 05 19:01:58.110458 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.110335 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj"] Aug 05 19:01:58.110458 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.110414 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:01:58.116059 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.115782 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Aug 05 19:01:58.116059 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.115871 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Aug 05 19:01:58.116217 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.116069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dlsg2\"" Aug 05 19:01:58.135417 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.135319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:58.153969 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.153930 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-default-certificate\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.153969 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.153967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/204d3b96-53de-4c09-a0e6-d34122bb5488-serving-cert\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.154179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.153987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-trusted-ca\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.154179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00857821-0bae-44c3-a656-0033cc3c0cfc-service-ca-bundle\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.154179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.154179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-stats-auth\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.154179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/48138494-3649-4697-9f11-fe42048dcd4f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.154179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00857821-0bae-44c3-a656-0033cc3c0cfc-tmp\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.154179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9dg\" (UniqueName: \"kubernetes.io/projected/fa857d4a-38b3-476c-9171-7161e80f7532-kube-api-access-lt9dg\") pod \"network-check-source-65bdbbff45-7tfb9\" (UID: \"fa857d4a-38b3-476c-9171-7161e80f7532\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9" Aug 05 19:01:58.154379 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-serving-cert\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.154379 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/204d3b96-53de-4c09-a0e6-d34122bb5488-config\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.154379 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sdcj\" (UniqueName: \"kubernetes.io/projected/48138494-3649-4697-9f11-fe42048dcd4f-kube-api-access-7sdcj\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.154379 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9s8\" (UniqueName: \"kubernetes.io/projected/fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e-kube-api-access-mv9s8\") pod \"volume-data-source-validator-5b8776669-z6xkr\" (UID: \"fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr" Aug 05 19:01:58.154505 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00857821-0bae-44c3-a656-0033cc3c0cfc-serving-cert\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.154505 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.154505 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-config\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.154643 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00857821-0bae-44c3-a656-0033cc3c0cfc-snapshots\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.154643 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154537 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00857821-0bae-44c3-a656-0033cc3c0cfc-tmp\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.154643 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg4tq\" (UniqueName: \"kubernetes.io/projected/c99440c4-09ca-4187-b83d-dedadb8ae375-kube-api-access-zg4tq\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.154643 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.154643 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwgx5\" (UniqueName: \"kubernetes.io/projected/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-kube-api-access-rwgx5\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.154870 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00857821-0bae-44c3-a656-0033cc3c0cfc-trusted-ca-bundle\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.154870 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtbjl\" (UniqueName: \"kubernetes.io/projected/00857821-0bae-44c3-a656-0033cc3c0cfc-kube-api-access-xtbjl\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.154870 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkkd4\" (UniqueName: \"kubernetes.io/projected/204d3b96-53de-4c09-a0e6-d34122bb5488-kube-api-access-lkkd4\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.154870 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.154709 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00857821-0bae-44c3-a656-0033cc3c0cfc-service-ca-bundle\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.155093 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.155068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/00857821-0bae-44c3-a656-0033cc3c0cfc-snapshots\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.155414 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.155397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00857821-0bae-44c3-a656-0033cc3c0cfc-trusted-ca-bundle\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.158263 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.158241 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00857821-0bae-44c3-a656-0033cc3c0cfc-serving-cert\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.163848 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.163818 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9s8\" (UniqueName: \"kubernetes.io/projected/fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e-kube-api-access-mv9s8\") pod \"volume-data-source-validator-5b8776669-z6xkr\" (UID: \"fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr" Aug 05 19:01:58.163964 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.163905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtbjl\" (UniqueName: \"kubernetes.io/projected/00857821-0bae-44c3-a656-0033cc3c0cfc-kube-api-access-xtbjl\") pod \"insights-operator-77696685b-kfhkc\" (UID: \"00857821-0bae-44c3-a656-0033cc3c0cfc\") " pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.203740 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.203699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr" Aug 05 19:01:58.206410 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.206377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:58.214235 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.214204 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-kfhkc" Aug 05 19:01:58.255926 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.255891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-config\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.256086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.255933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg4tq\" (UniqueName: \"kubernetes.io/projected/c99440c4-09ca-4187-b83d-dedadb8ae375-kube-api-access-zg4tq\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.256086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.255956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.256086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.255978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwgx5\" (UniqueName: \"kubernetes.io/projected/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-kube-api-access-rwgx5\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.256086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.255999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf6127ab-0a56-4428-89a1-d982e927322f-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.256307 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.256095 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 19:01:58.256307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkkd4\" (UniqueName: \"kubernetes.io/projected/204d3b96-53de-4c09-a0e6-d34122bb5488-kube-api-access-lkkd4\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.256307 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.256157 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:58.756136368 +0000 UTC m=+44.776199398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : secret "router-metrics-certs-default" not found Aug 05 19:01:58.256307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-default-certificate\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.256307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/204d3b96-53de-4c09-a0e6-d34122bb5488-serving-cert\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.256307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-trusted-ca\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.256635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhlps\" (UniqueName: \"kubernetes.io/projected/bf6127ab-0a56-4428-89a1-d982e927322f-kube-api-access-nhlps\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.256635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.256635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-stats-auth\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.256635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/48138494-3649-4697-9f11-fe42048dcd4f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.256635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9dg\" (UniqueName: \"kubernetes.io/projected/fa857d4a-38b3-476c-9171-7161e80f7532-kube-api-access-lt9dg\") pod \"network-check-source-65bdbbff45-7tfb9\" (UID: \"fa857d4a-38b3-476c-9171-7161e80f7532\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9" Aug 05 19:01:58.256901 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:01:58.256901 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256694 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-config\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.256901 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-serving-cert\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.256901 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/204d3b96-53de-4c09-a0e6-d34122bb5488-config\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.256901 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf6127ab-0a56-4428-89a1-d982e927322f-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.256901 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.256832 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:58.756815769 +0000 UTC m=+44.776878796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : configmap references non-existent config key: service-ca.crt Aug 05 19:01:58.256901 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:01:58.257305 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sdcj\" (UniqueName: \"kubernetes.io/projected/48138494-3649-4697-9f11-fe42048dcd4f-kube-api-access-7sdcj\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.257305 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.256960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rcx2\" (UniqueName: \"kubernetes.io/projected/6d8c518b-c0de-4e53-b9e7-849b7466f43c-kube-api-access-7rcx2\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:01:58.257305 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.257009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.257305 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.257036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc944e59-9f03-4a32-bb18-b7ccf0301847-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:01:58.257305 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.257250 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-trusted-ca\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.257588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.257338 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/204d3b96-53de-4c09-a0e6-d34122bb5488-config\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.257588 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.257379 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 19:01:58.257588 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.257425 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls podName:48138494-3649-4697-9f11-fe42048dcd4f nodeName:}" failed. No retries permitted until 2026-08-05 19:01:58.757411049 +0000 UTC m=+44.777474075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-h9nc8" (UID: "48138494-3649-4697-9f11-fe42048dcd4f") : secret "cluster-monitoring-operator-tls" not found Aug 05 19:01:58.257588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.257440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/48138494-3649-4697-9f11-fe42048dcd4f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.259033 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.259008 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/204d3b96-53de-4c09-a0e6-d34122bb5488-serving-cert\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.259657 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.259640 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-stats-auth\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.260215 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.260186 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-serving-cert\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.260298 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.260262 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-default-certificate\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.270734 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.270695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkkd4\" (UniqueName: \"kubernetes.io/projected/204d3b96-53de-4c09-a0e6-d34122bb5488-kube-api-access-lkkd4\") pod \"service-ca-operator-784f97bcf6-fw9fh\" (UID: \"204d3b96-53de-4c09-a0e6-d34122bb5488\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.271288 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.271269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg4tq\" (UniqueName: \"kubernetes.io/projected/c99440c4-09ca-4187-b83d-dedadb8ae375-kube-api-access-zg4tq\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.272323 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.272264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwgx5\" (UniqueName: \"kubernetes.io/projected/a4e3ee9a-4a8a-47b7-8303-56eefa1f9937-kube-api-access-rwgx5\") pod \"console-operator-5ccd6b445f-mzxn4\" (UID: \"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937\") " pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.272323 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.272282 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sdcj\" (UniqueName: \"kubernetes.io/projected/48138494-3649-4697-9f11-fe42048dcd4f-kube-api-access-7sdcj\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.274551 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.274526 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9dg\" (UniqueName: \"kubernetes.io/projected/fa857d4a-38b3-476c-9171-7161e80f7532-kube-api-access-lt9dg\") pod \"network-check-source-65bdbbff45-7tfb9\" (UID: \"fa857d4a-38b3-476c-9171-7161e80f7532\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9" Aug 05 19:01:58.286111 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.286074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" Aug 05 19:01:58.307674 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.307633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:58.315540 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.315493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:01:58.336477 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.336418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9" Aug 05 19:01:58.358292 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.358088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf6127ab-0a56-4428-89a1-d982e927322f-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.358292 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.358132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:01:58.358292 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.358171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rcx2\" (UniqueName: \"kubernetes.io/projected/6d8c518b-c0de-4e53-b9e7-849b7466f43c-kube-api-access-7rcx2\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:01:58.358292 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.358226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc944e59-9f03-4a32-bb18-b7ccf0301847-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:01:58.358292 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.358286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf6127ab-0a56-4428-89a1-d982e927322f-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.358654 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.358438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhlps\" (UniqueName: \"kubernetes.io/projected/bf6127ab-0a56-4428-89a1-d982e927322f-kube-api-access-nhlps\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.358654 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.358485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:01:58.359188 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.359166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf6127ab-0a56-4428-89a1-d982e927322f-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.359362 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.359343 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 19:01:58.359604 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.359414 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert podName:cc944e59-9f03-4a32-bb18-b7ccf0301847 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:58.859394502 +0000 UTC m=+44.879457547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-xcthw" (UID: "cc944e59-9f03-4a32-bb18-b7ccf0301847") : secret "networking-console-plugin-cert" not found Aug 05 19:01:58.359604 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.359541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc944e59-9f03-4a32-bb18-b7ccf0301847-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:01:58.359869 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.359692 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 19:01:58.359869 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.359772 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls podName:6d8c518b-c0de-4e53-b9e7-849b7466f43c nodeName:}" failed. No retries permitted until 2026-08-05 19:01:58.85973487 +0000 UTC m=+44.879797898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-f8jtj" (UID: "6d8c518b-c0de-4e53-b9e7-849b7466f43c") : secret "samples-operator-tls" not found Aug 05 19:01:58.361725 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.361691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf6127ab-0a56-4428-89a1-d982e927322f-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.368088 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.368003 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr"] Aug 05 19:01:58.371635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.371093 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhlps\" (UniqueName: \"kubernetes.io/projected/bf6127ab-0a56-4428-89a1-d982e927322f-kube-api-access-nhlps\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rch4b\" (UID: \"bf6127ab-0a56-4428-89a1-d982e927322f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.371635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.371261 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rcx2\" (UniqueName: \"kubernetes.io/projected/6d8c518b-c0de-4e53-b9e7-849b7466f43c-kube-api-access-7rcx2\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:01:58.374176 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.373965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:58.395157 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.395119 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" Aug 05 19:01:58.399075 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.399002 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-kfhkc"] Aug 05 19:01:58.417855 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:58.417797 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00857821_0bae_44c3_a656_0033cc3c0cfc.slice/crio-c27a975a027a7be3e9778def1b639e75bbecb87298c5d86ed13ddf1438592c7a WatchSource:0}: Error finding container c27a975a027a7be3e9778def1b639e75bbecb87298c5d86ed13ddf1438592c7a: Status 404 returned error can't find the container with id c27a975a027a7be3e9778def1b639e75bbecb87298c5d86ed13ddf1438592c7a Aug 05 19:01:58.443640 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.443573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:01:58.493527 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.493445 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh"] Aug 05 19:01:58.498552 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:58.498514 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204d3b96_53de_4c09_a0e6_d34122bb5488.slice/crio-f32576e2b8ea7a3ff39c1633d97dc36f8138de02409a087b5525f8384a878085 WatchSource:0}: Error finding container f32576e2b8ea7a3ff39c1633d97dc36f8138de02409a087b5525f8384a878085: Status 404 returned error can't find the container with id f32576e2b8ea7a3ff39c1633d97dc36f8138de02409a087b5525f8384a878085 Aug 05 19:01:58.528821 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.528792 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-mzxn4"] Aug 05 19:01:58.531594 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:58.531562 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e3ee9a_4a8a_47b7_8303_56eefa1f9937.slice/crio-4a1450337a6d4198246e324fba2be24984ffa97b40f5e87e7739bc3876844d74 WatchSource:0}: Error finding container 4a1450337a6d4198246e324fba2be24984ffa97b40f5e87e7739bc3876844d74: Status 404 returned error can't find the container with id 4a1450337a6d4198246e324fba2be24984ffa97b40f5e87e7739bc3876844d74 Aug 05 19:01:58.549687 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.549653 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9"] Aug 05 19:01:58.552571 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:58.552541 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa857d4a_38b3_476c_9171_7161e80f7532.slice/crio-f71ec2e675df22fb8b52d65c9115110a34be278f11e144073d43595d0ea2e84e WatchSource:0}: Error finding container f71ec2e675df22fb8b52d65c9115110a34be278f11e144073d43595d0ea2e84e: Status 404 returned error can't find the container with id f71ec2e675df22fb8b52d65c9115110a34be278f11e144073d43595d0ea2e84e Aug 05 19:01:58.595624 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.595590 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b"] Aug 05 19:01:58.598010 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:01:58.597985 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6127ab_0a56_4428_89a1_d982e927322f.slice/crio-b4393523aa9cef53881e629c0087bf2bc5964002809e484f0373678f067a66ba WatchSource:0}: Error finding container b4393523aa9cef53881e629c0087bf2bc5964002809e484f0373678f067a66ba: Status 404 returned error can't find the container with id b4393523aa9cef53881e629c0087bf2bc5964002809e484f0373678f067a66ba Aug 05 19:01:58.760573 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.760478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:58.760573 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.760528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.760774 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.760589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:58.760774 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.760633 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 19:01:58.760774 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.760701 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 19:01:58.760774 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.760710 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls podName:48138494-3649-4697-9f11-fe42048dcd4f nodeName:}" failed. No retries permitted until 2026-08-05 19:01:59.760689242 +0000 UTC m=+45.780752270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-h9nc8" (UID: "48138494-3649-4697-9f11-fe42048dcd4f") : secret "cluster-monitoring-operator-tls" not found Aug 05 19:01:58.760908 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.760790 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:59.760775223 +0000 UTC m=+45.780838252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : configmap references non-existent config key: service-ca.crt Aug 05 19:01:58.760908 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.760805 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:59.760798952 +0000 UTC m=+45.780861977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : secret "router-metrics-certs-default" not found Aug 05 19:01:58.773913 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.773882 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr" event={"ID":"fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e","Type":"ContainerStarted","Data":"9bfa6347f627961c6c22ac470ff9fc10d38ccc88822fbe8138ef082bb3bdfb50"} Aug 05 19:01:58.775000 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.774977 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9" event={"ID":"fa857d4a-38b3-476c-9171-7161e80f7532","Type":"ContainerStarted","Data":"f71ec2e675df22fb8b52d65c9115110a34be278f11e144073d43595d0ea2e84e"} Aug 05 19:01:58.775988 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.775969 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" event={"ID":"204d3b96-53de-4c09-a0e6-d34122bb5488","Type":"ContainerStarted","Data":"f32576e2b8ea7a3ff39c1633d97dc36f8138de02409a087b5525f8384a878085"} Aug 05 19:01:58.777239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.777220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kfhkc" event={"ID":"00857821-0bae-44c3-a656-0033cc3c0cfc","Type":"ContainerStarted","Data":"c27a975a027a7be3e9778def1b639e75bbecb87298c5d86ed13ddf1438592c7a"} Aug 05 19:01:58.778297 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.778277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" event={"ID":"bf6127ab-0a56-4428-89a1-d982e927322f","Type":"ContainerStarted","Data":"b4393523aa9cef53881e629c0087bf2bc5964002809e484f0373678f067a66ba"} Aug 05 19:01:58.779307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.779290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" event={"ID":"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937","Type":"ContainerStarted","Data":"4a1450337a6d4198246e324fba2be24984ffa97b40f5e87e7739bc3876844d74"} Aug 05 19:01:58.861940 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.861895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:01:58.862121 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:58.861966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:01:58.862121 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.862059 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 19:01:58.862121 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.862121 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert podName:cc944e59-9f03-4a32-bb18-b7ccf0301847 nodeName:}" failed. No retries permitted until 2026-08-05 19:01:59.862105488 +0000 UTC m=+45.882168516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-xcthw" (UID: "cc944e59-9f03-4a32-bb18-b7ccf0301847") : secret "networking-console-plugin-cert" not found Aug 05 19:01:58.862258 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.862059 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 19:01:58.862258 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:58.862201 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls podName:6d8c518b-c0de-4e53-b9e7-849b7466f43c nodeName:}" failed. No retries permitted until 2026-08-05 19:01:59.862188651 +0000 UTC m=+45.882251677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-f8jtj" (UID: "6d8c518b-c0de-4e53-b9e7-849b7466f43c") : secret "samples-operator-tls" not found Aug 05 19:01:59.769580 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:59.769534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:01:59.770091 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:59.769613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:59.770091 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.769700 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 19:01:59.770091 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:59.769716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:01:59.770091 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.769835 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls podName:48138494-3649-4697-9f11-fe42048dcd4f nodeName:}" failed. No retries permitted until 2026-08-05 19:02:01.769812146 +0000 UTC m=+47.789875181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-h9nc8" (UID: "48138494-3649-4697-9f11-fe42048dcd4f") : secret "cluster-monitoring-operator-tls" not found Aug 05 19:01:59.770091 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.769921 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 19:01:59.770091 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.769967 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:01.769954532 +0000 UTC m=+47.790017577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : secret "router-metrics-certs-default" not found Aug 05 19:01:59.770091 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.770035 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:01.770024315 +0000 UTC m=+47.790087364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : configmap references non-existent config key: service-ca.crt Aug 05 19:01:59.870403 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:59.870363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:01:59.870770 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:01:59.870442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:01:59.870770 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.870504 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 19:01:59.870770 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.870574 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert podName:cc944e59-9f03-4a32-bb18-b7ccf0301847 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:01.870554484 +0000 UTC m=+47.890617530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-xcthw" (UID: "cc944e59-9f03-4a32-bb18-b7ccf0301847") : secret "networking-console-plugin-cert" not found Aug 05 19:01:59.870770 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.870585 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 19:01:59.870770 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:01:59.870619 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls podName:6d8c518b-c0de-4e53-b9e7-849b7466f43c nodeName:}" failed. No retries permitted until 2026-08-05 19:02:01.870608322 +0000 UTC m=+47.890671351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-f8jtj" (UID: "6d8c518b-c0de-4e53-b9e7-849b7466f43c") : secret "samples-operator-tls" not found Aug 05 19:02:01.788712 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:01.788670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:01.789204 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.788833 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:05.78881067 +0000 UTC m=+51.808873715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : configmap references non-existent config key: service-ca.crt Aug 05 19:02:01.789204 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:01.788864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:02:01.789204 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:01.788921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:01.789204 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.789067 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 19:02:01.789204 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.789087 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 19:02:01.789204 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.789126 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:05.789113725 +0000 UTC m=+51.809176761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : secret "router-metrics-certs-default" not found Aug 05 19:02:01.789204 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.789149 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls podName:48138494-3649-4697-9f11-fe42048dcd4f nodeName:}" failed. No retries permitted until 2026-08-05 19:02:05.78913967 +0000 UTC m=+51.809202719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-h9nc8" (UID: "48138494-3649-4697-9f11-fe42048dcd4f") : secret "cluster-monitoring-operator-tls" not found Aug 05 19:02:01.890446 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:01.890406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:02:01.890629 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:01.890478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:02:01.890629 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.890569 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 19:02:01.890774 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.890642 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 19:02:01.890774 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.890650 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert podName:cc944e59-9f03-4a32-bb18-b7ccf0301847 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:05.890626379 +0000 UTC m=+51.910689405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-xcthw" (UID: "cc944e59-9f03-4a32-bb18-b7ccf0301847") : secret "networking-console-plugin-cert" not found Aug 05 19:02:01.890774 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:01.890718 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls podName:6d8c518b-c0de-4e53-b9e7-849b7466f43c nodeName:}" failed. No retries permitted until 2026-08-05 19:02:05.890699489 +0000 UTC m=+51.910762515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-f8jtj" (UID: "6d8c518b-c0de-4e53-b9e7-849b7466f43c") : secret "samples-operator-tls" not found Aug 05 19:02:02.302105 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:02.302060 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:02.381703 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:02.381667 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:02.485132 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:02.485095 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:02.583533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:02.583447 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:04.188921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.188881 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:04.214053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.213977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:02:04.214206 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.214073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:02:04.214206 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:04.214133 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 19:02:04.214206 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:04.214153 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777fff4966-bxbgm: secret "image-registry-tls" not found Aug 05 19:02:04.214317 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:04.214208 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls podName:35699ceb-76c2-4a58-b5a2-abde7236b151 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:20.214191546 +0000 UTC m=+66.234254573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls") pod "image-registry-777fff4966-bxbgm" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151") : secret "image-registry-tls" not found Aug 05 19:02:04.214317 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:04.214217 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 19:02:04.214317 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:04.214264 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls podName:d48840be-5068-46be-aa12-0ea789eb0a66 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:20.214251713 +0000 UTC m=+66.234314752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls") pod "dns-default-qmmbg" (UID: "d48840be-5068-46be-aa12-0ea789eb0a66") : secret "dns-default-metrics-tls" not found Aug 05 19:02:04.801079 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.801047 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr" event={"ID":"fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e","Type":"ContainerStarted","Data":"efd7ad5e7781c86f43159fff04258b44a6304f602b8ba9019401f01404232a4a"} Aug 05 19:02:04.802783 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.802715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9" event={"ID":"fa857d4a-38b3-476c-9171-7161e80f7532","Type":"ContainerStarted","Data":"fce8e4d3b659cb470d888812fdb0f3f7171625412e2a2080b421a69a908192bb"} Aug 05 19:02:04.804504 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.804474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" event={"ID":"204d3b96-53de-4c09-a0e6-d34122bb5488","Type":"ContainerStarted","Data":"5cf91789b8827b2d906623127728a0f8605a8999ff2b9c62889da8d9f270574b"} Aug 05 19:02:04.806149 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.806119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kfhkc" event={"ID":"00857821-0bae-44c3-a656-0033cc3c0cfc","Type":"ContainerStarted","Data":"e1a5da0bee614f6fc6b811156ca84cdc00b0111418fe1cbd5dd5a267ba84ab5f"} Aug 05 19:02:04.807803 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.807781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/0.log" Aug 05 19:02:04.807900 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.807820 2578 generic.go:356] "Generic (PLEG): container finished" podID="a4e3ee9a-4a8a-47b7-8303-56eefa1f9937" containerID="45ff4daecd1390a54c8d96b11e4c8d6e7fae3e2d00513935af42c8fd54aab826" exitCode=255 Aug 05 19:02:04.807900 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.807846 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" event={"ID":"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937","Type":"ContainerDied","Data":"45ff4daecd1390a54c8d96b11e4c8d6e7fae3e2d00513935af42c8fd54aab826"} Aug 05 19:02:04.808128 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.808111 2578 scope.go:117] "RemoveContainer" containerID="45ff4daecd1390a54c8d96b11e4c8d6e7fae3e2d00513935af42c8fd54aab826" Aug 05 19:02:04.816561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.816517 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-z6xkr" podStartSLOduration=1.573407525 podStartE2EDuration="7.816501946s" totalImagesPullingTime="6.243094421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:04.815156072 +0000 UTC m=+50.835219122" watchObservedRunningTime="2026-08-05 19:02:04.816501946 +0000 UTC m=+50.836564985" Aug 05 19:02:04.849574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.849511 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-7tfb9" podStartSLOduration=2.146565177 podStartE2EDuration="7.84948945s" totalImagesPullingTime="5.702924273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:04.847983977 +0000 UTC m=+50.868047027" watchObservedRunningTime="2026-08-05 19:02:04.84948945 +0000 UTC m=+50.869552499" Aug 05 19:02:04.866770 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.866540 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-kfhkc" podStartSLOduration=2.369640299 podStartE2EDuration="7.866518523s" totalImagesPullingTime="5.496878224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:04.8656153 +0000 UTC m=+50.885678349" watchObservedRunningTime="2026-08-05 19:02:04.866518523 +0000 UTC m=+50.886581571" Aug 05 19:02:04.885444 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:04.884984 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" podStartSLOduration=2.446701692 podStartE2EDuration="7.884966351s" totalImagesPullingTime="5.438264659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:04.884368466 +0000 UTC m=+50.904431516" watchObservedRunningTime="2026-08-05 19:02:04.884966351 +0000 UTC m=+50.905029448" Aug 05 19:02:05.189581 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.189448 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:05.251607 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.251461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:05.666913 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.666871 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h5qvd"] Aug 05 19:02:05.676153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.676108 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:05.684738 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.684708 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h5qvd"] Aug 05 19:02:05.684921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.684780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.687239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.687218 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 05 19:02:05.687239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.687237 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 05 19:02:05.687425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.687250 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gsd7c\"" Aug 05 19:02:05.731613 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.731581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-crio-socket\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.731820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.731634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.731820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.731687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-data-volume\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.731820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.731813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmln\" (UniqueName: \"kubernetes.io/projected/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-api-access-vhmln\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.731987 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.731840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.743074 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.743034 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:05.796029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.795992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:05.812623 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.812598 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:02:05.813050 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.813033 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/0.log" Aug 05 19:02:05.813141 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.813074 2578 generic.go:356] "Generic (PLEG): container finished" podID="a4e3ee9a-4a8a-47b7-8303-56eefa1f9937" containerID="bc83100cd09a93505d707b1e6fafd9f6ec70b2d157b61ab552aa343a0c5e909a" exitCode=255 Aug 05 19:02:05.813192 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.813156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" event={"ID":"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937","Type":"ContainerDied","Data":"bc83100cd09a93505d707b1e6fafd9f6ec70b2d157b61ab552aa343a0c5e909a"} Aug 05 19:02:05.813251 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.813203 2578 scope.go:117] "RemoveContainer" containerID="45ff4daecd1390a54c8d96b11e4c8d6e7fae3e2d00513935af42c8fd54aab826" Aug 05 19:02:05.813453 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.813427 2578 scope.go:117] "RemoveContainer" containerID="bc83100cd09a93505d707b1e6fafd9f6ec70b2d157b61ab552aa343a0c5e909a" Aug 05 19:02:05.813668 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.813635 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-mzxn4_openshift-console-operator(a4e3ee9a-4a8a-47b7-8303-56eefa1f9937)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" podUID="a4e3ee9a-4a8a-47b7-8303-56eefa1f9937" Aug 05 19:02:05.832907 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.832874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-crio-socket\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.833063 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.832953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.833063 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.832991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:02:05.833063 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.833018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-data-volume\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.833231 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.833064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:05.833231 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.833144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmln\" (UniqueName: \"kubernetes.io/projected/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-api-access-vhmln\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.833231 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.833180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.833231 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.833205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:05.833410 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833375 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:13.833356022 +0000 UTC m=+59.853419049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : configmap references non-existent config key: service-ca.crt Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833498 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833515 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833564 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833565 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:06.333547997 +0000 UTC m=+52.353611037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : configmap "kube-rbac-proxy" not found Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.833599 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-crio-socket\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833628 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:13.833615654 +0000 UTC m=+59.853678685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : secret "router-metrics-certs-default" not found Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833509 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833683 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:06.333665605 +0000 UTC m=+52.353728644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : secret "insights-runtime-extractor-tls" not found Aug 05 19:02:05.833717 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.833716 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls podName:48138494-3649-4697-9f11-fe42048dcd4f nodeName:}" failed. No retries permitted until 2026-08-05 19:02:13.8337006 +0000 UTC m=+59.853763626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-h9nc8" (UID: "48138494-3649-4697-9f11-fe42048dcd4f") : secret "cluster-monitoring-operator-tls" not found Aug 05 19:02:05.834142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.833902 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-data-volume\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.840702 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.840670 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmln\" (UniqueName: \"kubernetes.io/projected/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-api-access-vhmln\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:05.934984 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.934906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:02:05.935143 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:05.935016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:02:05.935143 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.935028 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 19:02:05.935143 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.935092 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert podName:cc944e59-9f03-4a32-bb18-b7ccf0301847 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:13.935073048 +0000 UTC m=+59.955136073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-xcthw" (UID: "cc944e59-9f03-4a32-bb18-b7ccf0301847") : secret "networking-console-plugin-cert" not found Aug 05 19:02:05.935312 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.935298 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 19:02:05.935376 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:05.935365 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls podName:6d8c518b-c0de-4e53-b9e7-849b7466f43c nodeName:}" failed. No retries permitted until 2026-08-05 19:02:13.935351562 +0000 UTC m=+59.955414588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-f8jtj" (UID: "6d8c518b-c0de-4e53-b9e7-849b7466f43c") : secret "samples-operator-tls" not found Aug 05 19:02:06.339354 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.339303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:06.339724 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:06.339452 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 19:02:06.339724 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.339519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:06.339724 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:06.339533 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:07.339511699 +0000 UTC m=+53.359574729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : configmap "kube-rbac-proxy" not found Aug 05 19:02:06.339724 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:06.339644 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 19:02:06.339724 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:06.339709 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:07.33969139 +0000 UTC m=+53.359754419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : secret "insights-runtime-extractor-tls" not found Aug 05 19:02:06.420405 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.420360 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:06.522218 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.522172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" limit=1024 Aug 05 19:02:06.817693 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.817656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" event={"ID":"bf6127ab-0a56-4428-89a1-d982e927322f","Type":"ContainerStarted","Data":"e4d066248f9649aeafeff8b288755fedcf8024956e9bf49d5bc60d2fa2a3a895"} Aug 05 19:02:06.819270 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.819252 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:02:06.819541 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.819526 2578 scope.go:117] "RemoveContainer" containerID="bc83100cd09a93505d707b1e6fafd9f6ec70b2d157b61ab552aa343a0c5e909a" Aug 05 19:02:06.819686 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:06.819669 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-mzxn4_openshift-console-operator(a4e3ee9a-4a8a-47b7-8303-56eefa1f9937)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" podUID="a4e3ee9a-4a8a-47b7-8303-56eefa1f9937" Aug 05 19:02:06.824114 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.824092 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j9m66_f8b682b2-bedb-4dbf-a585-50cccff11ef4/dns-node-resolver/0.log" Aug 05 19:02:06.835180 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:06.835123 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" podStartSLOduration=1.4174474369999999 podStartE2EDuration="8.835102968s" totalImagesPullingTime="7.417655531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:06.834092694 +0000 UTC m=+52.854155744" watchObservedRunningTime="2026-08-05 19:02:06.835102968 +0000 UTC m=+52.855166045" Aug 05 19:02:07.347952 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.347911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:07.348412 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.347998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:07.348412 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:07.348029 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 19:02:07.348412 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:07.348098 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 19:02:07.348412 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:07.348098 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:09.348081435 +0000 UTC m=+55.368144461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : configmap "kube-rbac-proxy" not found Aug 05 19:02:07.348412 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:07.348148 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:09.348136245 +0000 UTC m=+55.368199271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : secret "insights-runtime-extractor-tls" not found Aug 05 19:02:07.623781 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.623679 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-64mxw_5c0e56e0-d8f4-4537-91b2-97035dbbc26e/node-ca/0.log" Aug 05 19:02:07.718781 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.718715 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8"] Aug 05 19:02:07.721337 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.721315 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" Aug 05 19:02:07.724148 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.724117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Aug 05 19:02:07.724722 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.724694 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5pjqd\"" Aug 05 19:02:07.726564 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.726541 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Aug 05 19:02:07.731684 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.731654 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8"] Aug 05 19:02:07.752125 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.752082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h6wt\" (UniqueName: \"kubernetes.io/projected/aa2ec381-d183-4466-980d-ee0ff6a83457-kube-api-access-5h6wt\") pod \"migrator-68bc745d87-6xjp8\" (UID: \"aa2ec381-d183-4466-980d-ee0ff6a83457\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" Aug 05 19:02:07.853467 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.853424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h6wt\" (UniqueName: \"kubernetes.io/projected/aa2ec381-d183-4466-980d-ee0ff6a83457-kube-api-access-5h6wt\") pod \"migrator-68bc745d87-6xjp8\" (UID: \"aa2ec381-d183-4466-980d-ee0ff6a83457\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" Aug 05 19:02:07.865552 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:07.865512 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h6wt\" (UniqueName: \"kubernetes.io/projected/aa2ec381-d183-4466-980d-ee0ff6a83457-kube-api-access-5h6wt\") pod \"migrator-68bc745d87-6xjp8\" (UID: \"aa2ec381-d183-4466-980d-ee0ff6a83457\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" Aug 05 19:02:08.018098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.017995 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-jx6cb"] Aug 05 19:02:08.020446 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.020422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.023004 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.022970 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Aug 05 19:02:08.023219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.023131 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Aug 05 19:02:08.023219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.023159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-77f8n\"" Aug 05 19:02:08.023219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.023184 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Aug 05 19:02:08.023373 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.023248 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Aug 05 19:02:08.030225 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.030187 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-jx6cb"] Aug 05 19:02:08.032941 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.032919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" Aug 05 19:02:08.055417 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.055387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-signing-key\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.055417 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.055421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtfp\" (UniqueName: \"kubernetes.io/projected/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-kube-api-access-bwtfp\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.055611 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.055591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-signing-cabundle\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.156979 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.156938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-signing-cabundle\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.157153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.157097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-signing-key\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.157153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.157118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtfp\" (UniqueName: \"kubernetes.io/projected/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-kube-api-access-bwtfp\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.157741 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.157717 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-signing-cabundle\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.159534 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.159508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-signing-key\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.164611 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.164582 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8"] Aug 05 19:02:08.167024 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.167001 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtfp\" (UniqueName: \"kubernetes.io/projected/d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c-kube-api-access-bwtfp\") pod \"service-ca-98c88fbb5-jx6cb\" (UID: \"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c\") " pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.167928 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:08.167899 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2ec381_d183_4466_980d_ee0ff6a83457.slice/crio-5f7775d7eb4ea03c74e0eda41373ab312d40efccdf8696bbfb90eefb47aa37fc WatchSource:0}: Error finding container 5f7775d7eb4ea03c74e0eda41373ab312d40efccdf8696bbfb90eefb47aa37fc: Status 404 returned error can't find the container with id 5f7775d7eb4ea03c74e0eda41373ab312d40efccdf8696bbfb90eefb47aa37fc Aug 05 19:02:08.316713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.316685 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:02:08.316891 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.316742 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:02:08.317110 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.317097 2578 scope.go:117] "RemoveContainer" containerID="bc83100cd09a93505d707b1e6fafd9f6ec70b2d157b61ab552aa343a0c5e909a" Aug 05 19:02:08.317278 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:08.317256 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-mzxn4_openshift-console-operator(a4e3ee9a-4a8a-47b7-8303-56eefa1f9937)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" podUID="a4e3ee9a-4a8a-47b7-8303-56eefa1f9937" Aug 05 19:02:08.331078 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.331045 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" Aug 05 19:02:08.427657 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.427551 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fj2w_d9333206-a382-40f1-90ef-bfda175ba53d/serve-healthcheck-canary/0.log" Aug 05 19:02:08.461071 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.461029 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-jx6cb"] Aug 05 19:02:08.467488 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:08.467457 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ad37d0_7e00_4cac_9d90_3e7c8b8b203c.slice/crio-8d3839ae58fab38097b4c67138e9190d91da7bfaa88e26712c558d52d5dc5a0c WatchSource:0}: Error finding container 8d3839ae58fab38097b4c67138e9190d91da7bfaa88e26712c558d52d5dc5a0c: Status 404 returned error can't find the container with id 8d3839ae58fab38097b4c67138e9190d91da7bfaa88e26712c558d52d5dc5a0c Aug 05 19:02:08.829728 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.829687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" event={"ID":"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c","Type":"ContainerStarted","Data":"f5e160ccb8b928507a2d990722c7aa163bdeefb0d52d55d19afa5e086e9491b2"} Aug 05 19:02:08.829931 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.829773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" event={"ID":"d1ad37d0-7e00-4cac-9d90-3e7c8b8b203c","Type":"ContainerStarted","Data":"8d3839ae58fab38097b4c67138e9190d91da7bfaa88e26712c558d52d5dc5a0c"} Aug 05 19:02:08.831086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.831052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" event={"ID":"aa2ec381-d183-4466-980d-ee0ff6a83457","Type":"ContainerStarted","Data":"5f7775d7eb4ea03c74e0eda41373ab312d40efccdf8696bbfb90eefb47aa37fc"} Aug 05 19:02:08.848557 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:08.848501 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-jx6cb" podStartSLOduration=0.84848076 podStartE2EDuration="848.48076ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:08.847004867 +0000 UTC m=+54.867067915" watchObservedRunningTime="2026-08-05 19:02:08.84848076 +0000 UTC m=+54.868543808" Aug 05 19:02:09.370459 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:09.370415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:09.370654 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:09.370517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:09.370654 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:09.370536 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 19:02:09.370654 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:09.370600 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:13.370584589 +0000 UTC m=+59.390647618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : configmap "kube-rbac-proxy" not found Aug 05 19:02:09.370654 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:09.370630 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 19:02:09.370824 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:09.370679 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:13.370663217 +0000 UTC m=+59.390726259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : secret "insights-runtime-extractor-tls" not found Aug 05 19:02:09.837443 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:09.837402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" event={"ID":"aa2ec381-d183-4466-980d-ee0ff6a83457","Type":"ContainerStarted","Data":"c22bae9e7c48876fc77898873d08c5d573ac383cefefa13434c3a507415c8e8a"} Aug 05 19:02:09.838134 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:09.837469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" event={"ID":"aa2ec381-d183-4466-980d-ee0ff6a83457","Type":"ContainerStarted","Data":"7d392dead7685657e704270124d8819cd5191356e923db2d7f8e045f335646ac"} Aug 05 19:02:09.867223 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:09.867159 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-6xjp8" podStartSLOduration=1.889379865 podStartE2EDuration="2.867125115s" totalImagesPullingTime="977.74525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:09.865375076 +0000 UTC m=+55.885438128" watchObservedRunningTime="2026-08-05 19:02:09.867125115 +0000 UTC m=+55.887188165" Aug 05 19:02:13.408870 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:13.408827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:13.409322 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:13.408920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:13.409322 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.408948 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 19:02:13.409322 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.409020 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:21.409004391 +0000 UTC m=+67.429067417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : configmap "kube-rbac-proxy" not found Aug 05 19:02:13.409322 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.409050 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 19:02:13.409322 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.409094 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls podName:2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:21.40908323 +0000 UTC m=+67.429146256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5qvd" (UID: "2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6") : secret "insights-runtime-extractor-tls" not found Aug 05 19:02:13.914599 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:13.914548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:02:13.914818 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:13.914613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:13.914818 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.914719 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 19:02:13.914818 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.914719 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 19:02:13.914818 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.914812 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:29.914792509 +0000 UTC m=+75.934855538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : secret "router-metrics-certs-default" not found Aug 05 19:02:13.914975 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.914834 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls podName:48138494-3649-4697-9f11-fe42048dcd4f nodeName:}" failed. No retries permitted until 2026-08-05 19:02:29.914824313 +0000 UTC m=+75.934887344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-h9nc8" (UID: "48138494-3649-4697-9f11-fe42048dcd4f") : secret "cluster-monitoring-operator-tls" not found Aug 05 19:02:13.914975 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:13.914863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:13.915042 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:13.915005 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle podName:c99440c4-09ca-4187-b83d-dedadb8ae375 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:29.914994594 +0000 UTC m=+75.935057621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle") pod "router-default-7f999d9fc6-fwg8z" (UID: "c99440c4-09ca-4187-b83d-dedadb8ae375") : configmap references non-existent config key: service-ca.crt Aug 05 19:02:14.016236 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:14.016196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:02:14.016533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:14.016508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:02:14.016646 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:14.016632 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 19:02:14.016702 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:02:14.016693 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert podName:cc944e59-9f03-4a32-bb18-b7ccf0301847 nodeName:}" failed. No retries permitted until 2026-08-05 19:02:30.016677755 +0000 UTC m=+76.036740782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-xcthw" (UID: "cc944e59-9f03-4a32-bb18-b7ccf0301847") : secret "networking-console-plugin-cert" not found Aug 05 19:02:14.018921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:14.018892 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d8c518b-c0de-4e53-b9e7-849b7466f43c-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-f8jtj\" (UID: \"6d8c518b-c0de-4e53-b9e7-849b7466f43c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:02:14.309152 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:14.309113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" Aug 05 19:02:14.449048 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:14.449020 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj"] Aug 05 19:02:14.733059 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:14.732989 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-44jz2" Aug 05 19:02:14.854278 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:14.854240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" event={"ID":"6d8c518b-c0de-4e53-b9e7-849b7466f43c","Type":"ContainerStarted","Data":"dea7a4b6634de440c2603aeffe0a070ff5a5b3c6984344f01375d511cc8012d1"} Aug 05 19:02:16.864053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:16.863412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" event={"ID":"6d8c518b-c0de-4e53-b9e7-849b7466f43c","Type":"ContainerStarted","Data":"86ca7161fe2b3a71acaa0338f18c4bbfea03dcd1cc726791b7f158d5ee85e62b"} Aug 05 19:02:16.864053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:16.863484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" event={"ID":"6d8c518b-c0de-4e53-b9e7-849b7466f43c","Type":"ContainerStarted","Data":"abc04cbfff2d80233889675d535364994f805efe224ac5e46a564c1a992bea59"} Aug 05 19:02:16.883669 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:16.883613 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-f8jtj" podStartSLOduration=17.17537548 podStartE2EDuration="18.883593943s" totalImagesPullingTime="1.708218463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:16.882505358 +0000 UTC m=+62.902568408" watchObservedRunningTime="2026-08-05 19:02:16.883593943 +0000 UTC m=+62.903656992" Aug 05 19:02:19.266503 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.266465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:02:19.266503 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.266519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:02:19.269118 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.269098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 19:02:19.270025 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.270007 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 19:02:19.279376 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.279341 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d01c6b1-66c2-42ea-aa85-82e940e1cd30-original-pull-secret\") pod \"global-pull-secret-syncer-fdhbz\" (UID: \"6d01c6b1-66c2-42ea-aa85-82e940e1cd30\") " pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:02:19.279376 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.279356 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81923d9-f4de-436a-a04e-b6276d577090-metrics-certs\") pod \"network-metrics-daemon-g727w\" (UID: \"d81923d9-f4de-436a-a04e-b6276d577090\") " pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:02:19.367422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.367382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:02:19.369950 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.369917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk6rl\" (UniqueName: \"kubernetes.io/projected/ea1dfe1a-3cef-4843-a3d7-58328cfe82a5-kube-api-access-lk6rl\") pod \"network-check-target-njw24\" (UID: \"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5\") " pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:02:19.545997 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.545907 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wk5vf\"" Aug 05 19:02:19.554477 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.554440 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g727w" Aug 05 19:02:19.554937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.554916 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7thz\"" Aug 05 19:02:19.558121 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.558099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdhbz" Aug 05 19:02:19.562876 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.562860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:02:19.712902 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.712445 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g727w"] Aug 05 19:02:19.714275 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:19.714237 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd81923d9_f4de_436a_a04e_b6276d577090.slice/crio-075c3826982a14ebeff784ae95233a426763c315362c691fe20f65648a302d6f WatchSource:0}: Error finding container 075c3826982a14ebeff784ae95233a426763c315362c691fe20f65648a302d6f: Status 404 returned error can't find the container with id 075c3826982a14ebeff784ae95233a426763c315362c691fe20f65648a302d6f Aug 05 19:02:19.879169 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.879134 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g727w" event={"ID":"d81923d9-f4de-436a-a04e-b6276d577090","Type":"ContainerStarted","Data":"075c3826982a14ebeff784ae95233a426763c315362c691fe20f65648a302d6f"} Aug 05 19:02:19.938646 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.938619 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdhbz"] Aug 05 19:02:19.941347 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:19.941320 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-njw24"] Aug 05 19:02:19.941490 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:19.941457 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d01c6b1_66c2_42ea_aa85_82e940e1cd30.slice/crio-342aed5f70f8a2f46cc8f9b0aa3d5bedafb6a88edd8e3faa8128904cf4343d4a WatchSource:0}: Error finding container 342aed5f70f8a2f46cc8f9b0aa3d5bedafb6a88edd8e3faa8128904cf4343d4a: Status 404 returned error can't find the container with id 342aed5f70f8a2f46cc8f9b0aa3d5bedafb6a88edd8e3faa8128904cf4343d4a Aug 05 19:02:19.944096 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:19.944079 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1dfe1a_3cef_4843_a3d7_58328cfe82a5.slice/crio-d14a744d3d282e93f966b26a77cc3b4db416260152416e0138c6ed5b20210d18 WatchSource:0}: Error finding container d14a744d3d282e93f966b26a77cc3b4db416260152416e0138c6ed5b20210d18: Status 404 returned error can't find the container with id d14a744d3d282e93f966b26a77cc3b4db416260152416e0138c6ed5b20210d18 Aug 05 19:02:20.276450 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.276355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:02:20.276958 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.276468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:02:20.279139 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.279106 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d48840be-5068-46be-aa12-0ea789eb0a66-metrics-tls\") pod \"dns-default-qmmbg\" (UID: \"d48840be-5068-46be-aa12-0ea789eb0a66\") " pod="openshift-dns/dns-default-qmmbg" Aug 05 19:02:20.279282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.279204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"image-registry-777fff4966-bxbgm\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:02:20.442484 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.442449 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zb2vm\"" Aug 05 19:02:20.450633 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.450606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:02:20.461135 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.461104 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6qmv\"" Aug 05 19:02:20.469205 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.469175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qmmbg" Aug 05 19:02:20.531992 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.531919 2578 scope.go:117] "RemoveContainer" containerID="bc83100cd09a93505d707b1e6fafd9f6ec70b2d157b61ab552aa343a0c5e909a" Aug 05 19:02:20.823633 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.823606 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qmmbg"] Aug 05 19:02:20.827352 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:20.827321 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48840be_5068_46be_aa12_0ea789eb0a66.slice/crio-d53a06f4ab15415ca8a5813022ebc8652ea83910d7d55f2a60f41218eac2e5c9 WatchSource:0}: Error finding container d53a06f4ab15415ca8a5813022ebc8652ea83910d7d55f2a60f41218eac2e5c9: Status 404 returned error can't find the container with id d53a06f4ab15415ca8a5813022ebc8652ea83910d7d55f2a60f41218eac2e5c9 Aug 05 19:02:20.844427 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.844397 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777fff4966-bxbgm"] Aug 05 19:02:20.850340 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:20.849857 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35699ceb_76c2_4a58_b5a2_abde7236b151.slice/crio-47d91715c40b8b2ed3947bcc657202842eddb70e147fd60be12fa787ac4563f9 WatchSource:0}: Error finding container 47d91715c40b8b2ed3947bcc657202842eddb70e147fd60be12fa787ac4563f9: Status 404 returned error can't find the container with id 47d91715c40b8b2ed3947bcc657202842eddb70e147fd60be12fa787ac4563f9 Aug 05 19:02:20.889188 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.889156 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:02:20.889339 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.889294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" event={"ID":"a4e3ee9a-4a8a-47b7-8303-56eefa1f9937","Type":"ContainerStarted","Data":"dddd96a8dc6fe8caeb9c027424491cf835d057119dbae3c40dde63efec02282d"} Aug 05 19:02:20.889693 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.889629 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:02:20.891715 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.891686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qmmbg" event={"ID":"d48840be-5068-46be-aa12-0ea789eb0a66","Type":"ContainerStarted","Data":"d53a06f4ab15415ca8a5813022ebc8652ea83910d7d55f2a60f41218eac2e5c9"} Aug 05 19:02:20.894593 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.894502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-njw24" event={"ID":"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5","Type":"ContainerStarted","Data":"b25137e258d91ba1a9e5958b44d8889ba5b90d89d5efe5ddf0c0650434595e8a"} Aug 05 19:02:20.894593 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.894554 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-njw24" event={"ID":"ea1dfe1a-3cef-4843-a3d7-58328cfe82a5","Type":"ContainerStarted","Data":"d14a744d3d282e93f966b26a77cc3b4db416260152416e0138c6ed5b20210d18"} Aug 05 19:02:20.895020 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.894851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:02:20.896262 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.896233 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdhbz" event={"ID":"6d01c6b1-66c2-42ea-aa85-82e940e1cd30","Type":"ContainerStarted","Data":"342aed5f70f8a2f46cc8f9b0aa3d5bedafb6a88edd8e3faa8128904cf4343d4a"} Aug 05 19:02:20.899189 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.899106 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g727w" event={"ID":"d81923d9-f4de-436a-a04e-b6276d577090","Type":"ContainerStarted","Data":"31fa5438ef4c30ae34167013af7ed548aba2c3ad8a564e5339cdde7cc2c671f9"} Aug 05 19:02:20.901136 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.901071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" event={"ID":"35699ceb-76c2-4a58-b5a2-abde7236b151","Type":"ContainerStarted","Data":"47d91715c40b8b2ed3947bcc657202842eddb70e147fd60be12fa787ac4563f9"} Aug 05 19:02:20.908326 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.907602 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" podStartSLOduration=18.50255307 podStartE2EDuration="23.9075852s" totalImagesPullingTime="5.40503213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:20.907130119 +0000 UTC m=+66.927193169" watchObservedRunningTime="2026-08-05 19:02:20.9075852 +0000 UTC m=+66.927648251" Aug 05 19:02:20.922782 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:20.922356 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-njw24" podStartSLOduration=65.922336107 podStartE2EDuration="1m5.922336107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:20.921616662 +0000 UTC m=+66.941679711" watchObservedRunningTime="2026-08-05 19:02:20.922336107 +0000 UTC m=+66.942399185" Aug 05 19:02:21.492834 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.492395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:21.492834 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.492515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:21.493338 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.493114 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:21.498809 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.498720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5qvd\" (UID: \"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6\") " pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:21.597029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.596982 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gsd7c\"" Aug 05 19:02:21.605080 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.605013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h5qvd" Aug 05 19:02:21.796134 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.796050 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h5qvd"] Aug 05 19:02:21.800737 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:21.800311 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1b1b68_5c3e_4e67_ab88_96f0ca9f72c6.slice/crio-bd26dbc43374a7fa4d1dfabfeeb72e8fb8c5216782a51d47f99777fdc5348653 WatchSource:0}: Error finding container bd26dbc43374a7fa4d1dfabfeeb72e8fb8c5216782a51d47f99777fdc5348653: Status 404 returned error can't find the container with id bd26dbc43374a7fa4d1dfabfeeb72e8fb8c5216782a51d47f99777fdc5348653 Aug 05 19:02:21.855035 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.855018 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-mzxn4" Aug 05 19:02:21.912106 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.912026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g727w" event={"ID":"d81923d9-f4de-436a-a04e-b6276d577090","Type":"ContainerStarted","Data":"79f23e8a5e6c8f9b8c3e0660492583a152d904e7a79ec5982730e86994cf2969"} Aug 05 19:02:21.915355 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.915316 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" event={"ID":"35699ceb-76c2-4a58-b5a2-abde7236b151","Type":"ContainerStarted","Data":"5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017"} Aug 05 19:02:21.917010 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.916943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:02:21.919349 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.918831 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5qvd" event={"ID":"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6","Type":"ContainerStarted","Data":"e63f7f09a752d53ee5f9867d55998678c69d4fc19e2a39cf956e8c18e431798a"} Aug 05 19:02:21.919349 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.918891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5qvd" event={"ID":"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6","Type":"ContainerStarted","Data":"bd26dbc43374a7fa4d1dfabfeeb72e8fb8c5216782a51d47f99777fdc5348653"} Aug 05 19:02:21.930051 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.929981 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g727w" podStartSLOduration=65.937966221 podStartE2EDuration="1m6.929958217s" totalImagesPullingTime="991.991996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:21.928633929 +0000 UTC m=+67.948696978" watchObservedRunningTime="2026-08-05 19:02:21.929958217 +0000 UTC m=+67.950021267" Aug 05 19:02:21.952776 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:21.952688 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" podStartSLOduration=66.952667744 podStartE2EDuration="1m6.952667744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:21.951142134 +0000 UTC m=+67.971205241" watchObservedRunningTime="2026-08-05 19:02:21.952667744 +0000 UTC m=+67.972730791" Aug 05 19:02:22.926743 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:22.926637 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qmmbg" event={"ID":"d48840be-5068-46be-aa12-0ea789eb0a66","Type":"ContainerStarted","Data":"f0c6033b80e096b98a14134340426b3b1cd78b820a3a2beb136cc59e2268f515"} Aug 05 19:02:22.926743 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:22.926711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qmmbg" event={"ID":"d48840be-5068-46be-aa12-0ea789eb0a66","Type":"ContainerStarted","Data":"4c102debfe50d65cd1b5d52069e7cf448b20fec1e7520bbc43ae2350d5652ba2"} Aug 05 19:02:22.944826 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:22.944741 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qmmbg" podStartSLOduration=33.183872281 podStartE2EDuration="34.944724912s" totalImagesPullingTime="1.760852631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:22.944454962 +0000 UTC m=+68.964518011" watchObservedRunningTime="2026-08-05 19:02:22.944724912 +0000 UTC m=+68.964787959" Aug 05 19:02:23.930981 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:23.930935 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qmmbg" Aug 05 19:02:24.935745 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:24.935707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5qvd" event={"ID":"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6","Type":"ContainerStarted","Data":"aaf7ba5a430107176bfe3faab35485e730085e2c6846a218b4745e2606bafd4e"} Aug 05 19:02:24.937146 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:24.937119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdhbz" event={"ID":"6d01c6b1-66c2-42ea-aa85-82e940e1cd30","Type":"ContainerStarted","Data":"10cd2d754f83c207ceabe56bb68f09a7418e9b04b3fa2880ca97464a6e3e2057"} Aug 05 19:02:24.953508 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:24.953389 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fdhbz" podStartSLOduration=65.575415432 podStartE2EDuration="1m9.953366426s" totalImagesPullingTime="4.377950994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:24.95173992 +0000 UTC m=+70.971802977" watchObservedRunningTime="2026-08-05 19:02:24.953366426 +0000 UTC m=+70.973429474" Aug 05 19:02:26.946625 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:26.946584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5qvd" event={"ID":"2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6","Type":"ContainerStarted","Data":"c4ac1bbcd84e5639fbb29b4d3e5f9cdb8f5dce303f20d2388b85f7ed00d375ef"} Aug 05 19:02:26.963271 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:26.963217 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h5qvd" podStartSLOduration=17.627184988 podStartE2EDuration="21.963198908s" totalImagesPullingTime="4.33601392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 19:02:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:26.962183285 +0000 UTC m=+72.982246336" watchObservedRunningTime="2026-08-05 19:02:26.963198908 +0000 UTC m=+72.983261956" Aug 05 19:02:29.744460 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.744413 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7"] Aug 05 19:02:29.748358 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.748327 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d"] Aug 05 19:02:29.748546 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.748496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" Aug 05 19:02:29.752040 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.751566 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cjfdz\"" Aug 05 19:02:29.752040 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.751862 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Aug 05 19:02:29.752040 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.751888 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Aug 05 19:02:29.752040 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.751927 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Aug 05 19:02:29.752646 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.752623 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-fwkqn"] Aug 05 19:02:29.752946 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.752930 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.753646 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.753629 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Aug 05 19:02:29.757199 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.757178 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52"] Aug 05 19:02:29.757434 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.757218 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Aug 05 19:02:29.757985 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.757294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-fwkqn" Aug 05 19:02:29.760257 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.760236 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bxvgd\"" Aug 05 19:02:29.760454 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.760283 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 05 19:02:29.760722 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.760699 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7"] Aug 05 19:02:29.760858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.760823 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.761029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.761008 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 05 19:02:29.761797 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.761778 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d"] Aug 05 19:02:29.763238 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.763219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Aug 05 19:02:29.763635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.763621 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Aug 05 19:02:29.774827 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.774763 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Aug 05 19:02:29.775244 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.775220 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Aug 05 19:02:29.776741 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.776717 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52"] Aug 05 19:02:29.784180 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.784155 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-fwkqn"] Aug 05 19:02:29.875947 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.875910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvlw2\" (UniqueName: \"kubernetes.io/projected/e568b0d4-9f90-4af4-b639-8011c4c14296-kube-api-access-zvlw2\") pod \"managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7\" (UID: \"e568b0d4-9f90-4af4-b639-8011c4c14296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" Aug 05 19:02:29.875947 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.875952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4078b90a-f6a6-40eb-a97a-ab0129436010-klusterlet-config\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.876160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkx8f\" (UniqueName: \"kubernetes.io/projected/4078b90a-f6a6-40eb-a97a-ab0129436010-kube-api-access-mkx8f\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.876160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrzgf\" (UniqueName: \"kubernetes.io/projected/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-kube-api-access-hrzgf\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.876160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-ca\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.876256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e568b0d4-9f90-4af4-b639-8011c4c14296-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7\" (UID: \"e568b0d4-9f90-4af4-b639-8011c4c14296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" Aug 05 19:02:29.876256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.876256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.876345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4078b90a-f6a6-40eb-a97a-ab0129436010-tmp\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.876345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-hub\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.876345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r6l8\" (UniqueName: \"kubernetes.io/projected/6af50039-0f90-4d9e-b7b1-0e12093f48bf-kube-api-access-9r6l8\") pod \"downloads-77c974ffcf-fwkqn\" (UID: \"6af50039-0f90-4d9e-b7b1-0e12093f48bf\") " pod="openshift-console/downloads-77c974ffcf-fwkqn" Aug 05 19:02:29.876433 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.876396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.977885 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.977848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlw2\" (UniqueName: \"kubernetes.io/projected/e568b0d4-9f90-4af4-b639-8011c4c14296-kube-api-access-zvlw2\") pod \"managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7\" (UID: \"e568b0d4-9f90-4af4-b639-8011c4c14296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" Aug 05 19:02:29.977885 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.977890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4078b90a-f6a6-40eb-a97a-ab0129436010-klusterlet-config\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.978128 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.977923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkx8f\" (UniqueName: \"kubernetes.io/projected/4078b90a-f6a6-40eb-a97a-ab0129436010-kube-api-access-mkx8f\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.978128 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.977949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrzgf\" (UniqueName: \"kubernetes.io/projected/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-kube-api-access-hrzgf\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.978128 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.977975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-ca\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.978128 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:02:29.978128 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e568b0d4-9f90-4af4-b639-8011c4c14296-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7\" (UID: \"e568b0d4-9f90-4af4-b639-8011c4c14296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" Aug 05 19:02:29.978128 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.978422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.978422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:29.978422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4078b90a-f6a6-40eb-a97a-ab0129436010-tmp\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.978422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-hub\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.978422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r6l8\" (UniqueName: \"kubernetes.io/projected/6af50039-0f90-4d9e-b7b1-0e12093f48bf-kube-api-access-9r6l8\") pod \"downloads-77c974ffcf-fwkqn\" (UID: \"6af50039-0f90-4d9e-b7b1-0e12093f48bf\") " pod="openshift-console/downloads-77c974ffcf-fwkqn" Aug 05 19:02:29.978422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:29.978422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.978769 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.978665 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4078b90a-f6a6-40eb-a97a-ab0129436010-tmp\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.979573 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.979489 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99440c4-09ca-4187-b83d-dedadb8ae375-service-ca-bundle\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:29.979837 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.979813 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.981273 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.981242 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-ca\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.981383 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.981317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.981427 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.981411 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4078b90a-f6a6-40eb-a97a-ab0129436010-klusterlet-config\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.981649 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.981626 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e568b0d4-9f90-4af4-b639-8011c4c14296-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7\" (UID: \"e568b0d4-9f90-4af4-b639-8011c4c14296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" Aug 05 19:02:29.981782 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.981699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c99440c4-09ca-4187-b83d-dedadb8ae375-metrics-certs\") pod \"router-default-7f999d9fc6-fwg8z\" (UID: \"c99440c4-09ca-4187-b83d-dedadb8ae375\") " pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:29.982185 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.982141 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-hub\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.982294 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.982268 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.982789 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.982771 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/48138494-3649-4697-9f11-fe42048dcd4f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-h9nc8\" (UID: \"48138494-3649-4697-9f11-fe42048dcd4f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:02:29.987268 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.987238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrzgf\" (UniqueName: \"kubernetes.io/projected/4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0-kube-api-access-hrzgf\") pod \"cluster-proxy-proxy-agent-d7dc595f5-qwr52\" (UID: \"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:29.987357 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.987266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkx8f\" (UniqueName: \"kubernetes.io/projected/4078b90a-f6a6-40eb-a97a-ab0129436010-kube-api-access-mkx8f\") pod \"klusterlet-addon-workmgr-5474f5496d-zmj6d\" (UID: \"4078b90a-f6a6-40eb-a97a-ab0129436010\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:29.987601 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.987583 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r6l8\" (UniqueName: \"kubernetes.io/projected/6af50039-0f90-4d9e-b7b1-0e12093f48bf-kube-api-access-9r6l8\") pod \"downloads-77c974ffcf-fwkqn\" (UID: \"6af50039-0f90-4d9e-b7b1-0e12093f48bf\") " pod="openshift-console/downloads-77c974ffcf-fwkqn" Aug 05 19:02:29.988077 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:29.988057 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvlw2\" (UniqueName: \"kubernetes.io/projected/e568b0d4-9f90-4af4-b639-8011c4c14296-kube-api-access-zvlw2\") pod \"managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7\" (UID: \"e568b0d4-9f90-4af4-b639-8011c4c14296\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" Aug 05 19:02:30.070970 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.070935 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" Aug 05 19:02:30.078714 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.078680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:30.078929 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.078905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:02:30.081502 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.081464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc944e59-9f03-4a32-bb18-b7ccf0301847-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xcthw\" (UID: \"cc944e59-9f03-4a32-bb18-b7ccf0301847\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:02:30.087351 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.086249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-fwkqn" Aug 05 19:02:30.092080 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.092057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" Aug 05 19:02:30.104656 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.104428 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g95qw\"" Aug 05 19:02:30.112868 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.112815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" Aug 05 19:02:30.131842 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.130337 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xkdt7\"" Aug 05 19:02:30.139008 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.138973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:30.221690 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.221036 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dlsg2\"" Aug 05 19:02:30.229168 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.228855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" Aug 05 19:02:30.264261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.263326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7"] Aug 05 19:02:30.268329 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:30.268292 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode568b0d4_9f90_4af4_b639_8011c4c14296.slice/crio-ec0c3a865b841d9cdf5b0f3038dad9c30bff8759de3694db2c40e01888ce62e3 WatchSource:0}: Error finding container ec0c3a865b841d9cdf5b0f3038dad9c30bff8759de3694db2c40e01888ce62e3: Status 404 returned error can't find the container with id ec0c3a865b841d9cdf5b0f3038dad9c30bff8759de3694db2c40e01888ce62e3 Aug 05 19:02:30.305896 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.305716 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d"] Aug 05 19:02:30.311833 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:30.311696 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4078b90a_f6a6_40eb_a97a_ab0129436010.slice/crio-f3cf59aeea084d19602c77e1fa3e047ef798a5e52790a7a7a6ee9f4609fac2e4 WatchSource:0}: Error finding container f3cf59aeea084d19602c77e1fa3e047ef798a5e52790a7a7a6ee9f4609fac2e4: Status 404 returned error can't find the container with id f3cf59aeea084d19602c77e1fa3e047ef798a5e52790a7a7a6ee9f4609fac2e4 Aug 05 19:02:30.343792 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.343731 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52"] Aug 05 19:02:30.347736 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:30.347698 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fbd0eb8_69bc_417e_a3e7_ba448b8f97c0.slice/crio-974cdc3288cd108fa64afa31c3e36ccecc770be92159018552d3d78288b76fba WatchSource:0}: Error finding container 974cdc3288cd108fa64afa31c3e36ccecc770be92159018552d3d78288b76fba: Status 404 returned error can't find the container with id 974cdc3288cd108fa64afa31c3e36ccecc770be92159018552d3d78288b76fba Aug 05 19:02:30.363032 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.363007 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8"] Aug 05 19:02:30.366187 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:30.366157 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48138494_3649_4697_9f11_fe42048dcd4f.slice/crio-e83266d10afead0eb8e820f50863443cf8a0d04aa0a21b4197e8d053ad117a79 WatchSource:0}: Error finding container e83266d10afead0eb8e820f50863443cf8a0d04aa0a21b4197e8d053ad117a79: Status 404 returned error can't find the container with id e83266d10afead0eb8e820f50863443cf8a0d04aa0a21b4197e8d053ad117a79 Aug 05 19:02:30.391009 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.390848 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f999d9fc6-fwg8z"] Aug 05 19:02:30.394187 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:30.394154 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99440c4_09ca_4187_b83d_dedadb8ae375.slice/crio-2c929a21bacd3f6ceccf9b8a778fe7a4cc1c91419c6fa6af0761ba641c011cfb WatchSource:0}: Error finding container 2c929a21bacd3f6ceccf9b8a778fe7a4cc1c91419c6fa6af0761ba641c011cfb: Status 404 returned error can't find the container with id 2c929a21bacd3f6ceccf9b8a778fe7a4cc1c91419c6fa6af0761ba641c011cfb Aug 05 19:02:30.406483 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.406461 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-xcthw"] Aug 05 19:02:30.408420 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:30.408395 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc944e59_9f03_4a32_bb18_b7ccf0301847.slice/crio-2dccde0638edcea6d65fd0f639bf3346d53a83a21d89e035323e5e6f2b594e8d WatchSource:0}: Error finding container 2dccde0638edcea6d65fd0f639bf3346d53a83a21d89e035323e5e6f2b594e8d: Status 404 returned error can't find the container with id 2dccde0638edcea6d65fd0f639bf3346d53a83a21d89e035323e5e6f2b594e8d Aug 05 19:02:30.503771 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.503727 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-fwkqn"] Aug 05 19:02:30.506519 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:30.506490 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af50039_0f90_4d9e_b7b1_0e12093f48bf.slice/crio-b97f028deab9c2e35713a3bf1b2f62cb17d2173b799126535485753c21252283 WatchSource:0}: Error finding container b97f028deab9c2e35713a3bf1b2f62cb17d2173b799126535485753c21252283: Status 404 returned error can't find the container with id b97f028deab9c2e35713a3bf1b2f62cb17d2173b799126535485753c21252283 Aug 05 19:02:30.970777 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.970722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" event={"ID":"c99440c4-09ca-4187-b83d-dedadb8ae375","Type":"ContainerStarted","Data":"bc1c171b02f3dac44f973d9b6052b3e4244dbc1c91e1d1468028dee1b42fb0b8"} Aug 05 19:02:30.971427 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.971377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" event={"ID":"c99440c4-09ca-4187-b83d-dedadb8ae375","Type":"ContainerStarted","Data":"2c929a21bacd3f6ceccf9b8a778fe7a4cc1c91419c6fa6af0761ba641c011cfb"} Aug 05 19:02:30.977721 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.977689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" event={"ID":"48138494-3649-4697-9f11-fe42048dcd4f","Type":"ContainerStarted","Data":"e83266d10afead0eb8e820f50863443cf8a0d04aa0a21b4197e8d053ad117a79"} Aug 05 19:02:30.979824 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.979793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" event={"ID":"cc944e59-9f03-4a32-bb18-b7ccf0301847","Type":"ContainerStarted","Data":"2dccde0638edcea6d65fd0f639bf3346d53a83a21d89e035323e5e6f2b594e8d"} Aug 05 19:02:30.981409 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.981378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" event={"ID":"4078b90a-f6a6-40eb-a97a-ab0129436010","Type":"ContainerStarted","Data":"f3cf59aeea084d19602c77e1fa3e047ef798a5e52790a7a7a6ee9f4609fac2e4"} Aug 05 19:02:30.995554 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.995473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" event={"ID":"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0","Type":"ContainerStarted","Data":"974cdc3288cd108fa64afa31c3e36ccecc770be92159018552d3d78288b76fba"} Aug 05 19:02:30.999566 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:30.999484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-fwkqn" event={"ID":"6af50039-0f90-4d9e-b7b1-0e12093f48bf","Type":"ContainerStarted","Data":"b97f028deab9c2e35713a3bf1b2f62cb17d2173b799126535485753c21252283"} Aug 05 19:02:31.004770 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:31.004192 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" podStartSLOduration=34.004169256 podStartE2EDuration="34.004169256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:31.000813609 +0000 UTC m=+77.020876658" watchObservedRunningTime="2026-08-05 19:02:31.004169256 +0000 UTC m=+77.024232305" Aug 05 19:02:31.005116 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:31.005041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" event={"ID":"e568b0d4-9f90-4af4-b639-8011c4c14296","Type":"ContainerStarted","Data":"ec0c3a865b841d9cdf5b0f3038dad9c30bff8759de3694db2c40e01888ce62e3"} Aug 05 19:02:31.140311 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:31.140213 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:31.145155 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:31.144915 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:32.015516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:32.015442 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:32.017842 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:32.017575 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f999d9fc6-fwg8z" Aug 05 19:02:33.939457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:33.939424 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qmmbg" Aug 05 19:02:40.065899 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.065852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" event={"ID":"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0","Type":"ContainerStarted","Data":"92d8b7d8643ae36c892eb5f46e7683098f1efa2eb9c121eeac246aea73a94998"} Aug 05 19:02:40.066406 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.065915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" event={"ID":"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0","Type":"ContainerStarted","Data":"5c09e8dbfa613e71ae612b77deb00f2311b7d3c0a3efbc02c7c31f3b5b19d266"} Aug 05 19:02:40.066406 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.065935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" event={"ID":"4fbd0eb8-69bc-417e-a3e7-ba448b8f97c0","Type":"ContainerStarted","Data":"451136acd54856ed3129792620c896ac6bdb12778e6a9ceef67ae45fc7eb6703"} Aug 05 19:02:40.068463 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.068430 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" event={"ID":"e568b0d4-9f90-4af4-b639-8011c4c14296","Type":"ContainerStarted","Data":"93462639bd8aafb005a20ab00d5f48711c8d9ed920360bc5332be7734e0af874"} Aug 05 19:02:40.072041 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.071951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" event={"ID":"48138494-3649-4697-9f11-fe42048dcd4f","Type":"ContainerStarted","Data":"fc981f7d367945bd08d373056ce33750a8cd739e970e25c2edf2c3fca36520cb"} Aug 05 19:02:40.073894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.073866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" event={"ID":"cc944e59-9f03-4a32-bb18-b7ccf0301847","Type":"ContainerStarted","Data":"26079230b8cee83865779b2baa83f85be180fa682fa9f5a7351182fac2e7df9e"} Aug 05 19:02:40.075636 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.075613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" event={"ID":"4078b90a-f6a6-40eb-a97a-ab0129436010","Type":"ContainerStarted","Data":"da55e2d8c588122fdb0f1664ef704cc84a011b94e50f0de70808fd81d266ebdb"} Aug 05 19:02:40.075824 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.075799 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:40.078117 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.078073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" Aug 05 19:02:40.084959 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.084905 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d7dc595f5-qwr52" podStartSLOduration=2.136555389 podStartE2EDuration="11.084887627s" totalImagesPullingTime="8.948332238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:40.084638517 +0000 UTC m=+86.104701574" watchObservedRunningTime="2026-08-05 19:02:40.084887627 +0000 UTC m=+86.104950678" Aug 05 19:02:40.099661 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.099606 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7ff5fddbfd-mmbt7" podStartSLOduration=2.09747569 podStartE2EDuration="11.09959005s" totalImagesPullingTime="9.00211436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:40.098399649 +0000 UTC m=+86.118462698" watchObservedRunningTime="2026-08-05 19:02:40.09959005 +0000 UTC m=+86.119653075" Aug 05 19:02:40.115609 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.115539 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5474f5496d-zmj6d" podStartSLOduration=2.156680801 podStartE2EDuration="11.115518276s" totalImagesPullingTime="8.958837475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:40.114497772 +0000 UTC m=+86.134560835" watchObservedRunningTime="2026-08-05 19:02:40.115518276 +0000 UTC m=+86.135581326" Aug 05 19:02:40.133641 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.132182 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-h9nc8" podStartSLOduration=34.230763642 podStartE2EDuration="43.132159595s" totalImagesPullingTime="8.901395953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:40.131184296 +0000 UTC m=+86.151247343" watchObservedRunningTime="2026-08-05 19:02:40.132159595 +0000 UTC m=+86.152222644" Aug 05 19:02:40.150322 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.150225 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xcthw" podStartSLOduration=33.373062865 podStartE2EDuration="42.150202459s" totalImagesPullingTime="8.777139594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:40.148526943 +0000 UTC m=+86.168589992" watchObservedRunningTime="2026-08-05 19:02:40.150202459 +0000 UTC m=+86.170265510" Aug 05 19:02:40.456461 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.456369 2578 patch_prober.go:28] interesting pod/image-registry-777fff4966-bxbgm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Aug 05 19:02:40.456461 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:40.456437 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" podUID="35699ceb-76c2-4a58-b5a2-abde7236b151" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 19:02:42.931822 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:42.931788 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:02:48.295324 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.295262 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pdv27"] Aug 05 19:02:48.337195 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.337158 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.341117 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.341066 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 05 19:02:48.342343 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.342310 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 05 19:02:48.342603 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.342341 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 05 19:02:48.342603 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.342341 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 05 19:02:48.342603 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.342310 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-47nns\"" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.448965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-textfile\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.449042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-sys\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.449062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.449086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-tls\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.449109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.449125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-root\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.449153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8025291c-3df4-405e-9d34-2f6e52207c6a-metrics-client-ca\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.449182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-wtmp\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.449261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.449204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv5bn\" (UniqueName: \"kubernetes.io/projected/8025291c-3df4-405e-9d34-2f6e52207c6a-kube-api-access-sv5bn\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.550891 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.550851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551069 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.550899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-root\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551069 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.550942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8025291c-3df4-405e-9d34-2f6e52207c6a-metrics-client-ca\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551069 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.550971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-wtmp\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551069 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.550995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv5bn\" (UniqueName: \"kubernetes.io/projected/8025291c-3df4-405e-9d34-2f6e52207c6a-kube-api-access-sv5bn\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551069 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.551035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-textfile\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551318 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.551103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-sys\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551318 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.551128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551318 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.551162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-tls\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.551561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.551504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-wtmp\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.552201 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.552177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-textfile\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.552584 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.552562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-root\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.552672 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.552624 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8025291c-3df4-405e-9d34-2f6e52207c6a-sys\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.553177 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.553155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8025291c-3df4-405e-9d34-2f6e52207c6a-metrics-client-ca\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.553629 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.553606 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.555255 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.555221 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-tls\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.555959 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.555934 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8025291c-3df4-405e-9d34-2f6e52207c6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.560403 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.560375 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv5bn\" (UniqueName: \"kubernetes.io/projected/8025291c-3df4-405e-9d34-2f6e52207c6a-kube-api-access-sv5bn\") pod \"node-exporter-pdv27\" (UID: \"8025291c-3df4-405e-9d34-2f6e52207c6a\") " pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:48.650525 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:48.650483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pdv27" Aug 05 19:02:50.082164 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:02:50.082111 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8025291c_3df4_405e_9d34_2f6e52207c6a.slice/crio-db9de10a228f34d965871b6f45fdb0e417b0a0a01fdee4ea2350446b37c9728c WatchSource:0}: Error finding container db9de10a228f34d965871b6f45fdb0e417b0a0a01fdee4ea2350446b37c9728c: Status 404 returned error can't find the container with id db9de10a228f34d965871b6f45fdb0e417b0a0a01fdee4ea2350446b37c9728c Aug 05 19:02:50.125163 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:50.125122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pdv27" event={"ID":"8025291c-3df4-405e-9d34-2f6e52207c6a","Type":"ContainerStarted","Data":"db9de10a228f34d965871b6f45fdb0e417b0a0a01fdee4ea2350446b37c9728c"} Aug 05 19:02:51.131735 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:51.131686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-fwkqn" event={"ID":"6af50039-0f90-4d9e-b7b1-0e12093f48bf","Type":"ContainerStarted","Data":"05f8e825fca4ab49c1742e365cba5804e624f0f50b9c93001c96da7c2207ef4f"} Aug 05 19:02:51.132256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:51.131932 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-fwkqn" Aug 05 19:02:51.150742 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:51.150679 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-fwkqn" podStartSLOduration=2.333335302 podStartE2EDuration="22.150660428s" totalImagesPullingTime="19.817325126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:51.147696666 +0000 UTC m=+97.167759716" watchObservedRunningTime="2026-08-05 19:02:51.150660428 +0000 UTC m=+97.170723477" Aug 05 19:02:51.151736 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:51.151702 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-fwkqn" Aug 05 19:02:51.923013 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:51.922978 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-njw24" Aug 05 19:02:52.138930 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:52.138884 2578 generic.go:356] "Generic (PLEG): container finished" podID="8025291c-3df4-405e-9d34-2f6e52207c6a" containerID="51d10cd790bf1b62d4471b11bc2493a628727545dc17c34ed106d01418929750" exitCode=0 Aug 05 19:02:52.139438 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:52.138978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pdv27" event={"ID":"8025291c-3df4-405e-9d34-2f6e52207c6a","Type":"ContainerDied","Data":"51d10cd790bf1b62d4471b11bc2493a628727545dc17c34ed106d01418929750"} Aug 05 19:02:53.147043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:53.146997 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pdv27" event={"ID":"8025291c-3df4-405e-9d34-2f6e52207c6a","Type":"ContainerStarted","Data":"56c3f1a11974cf364656f0e5ff01596bb6e7e78c94a89e0edb128394bb81c1fe"} Aug 05 19:02:53.147573 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:53.147067 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pdv27" event={"ID":"8025291c-3df4-405e-9d34-2f6e52207c6a","Type":"ContainerStarted","Data":"2d62a9ca2979ef1e6b2bf12f92d79ce42005397357b6965d689f67cfe0476c91"} Aug 05 19:02:53.167468 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:53.167390 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pdv27" podStartSLOduration=3.611504369 podStartE2EDuration="5.167364733s" totalImagesPullingTime="1.461914298s" totalInitContainerRuntime="93.946066ms" isStatefulPod=true podCreationTimestamp="2026-08-05 19:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:02:53.165093494 +0000 UTC m=+99.185156543" watchObservedRunningTime="2026-08-05 19:02:53.167364733 +0000 UTC m=+99.187427782" Aug 05 19:02:53.268188 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:02:53.268095 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777fff4966-bxbgm"] Aug 05 19:03:15.241053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:15.241014 2578 generic.go:356] "Generic (PLEG): container finished" podID="204d3b96-53de-4c09-a0e6-d34122bb5488" containerID="5cf91789b8827b2d906623127728a0f8605a8999ff2b9c62889da8d9f270574b" exitCode=0 Aug 05 19:03:15.241474 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:15.241067 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" event={"ID":"204d3b96-53de-4c09-a0e6-d34122bb5488","Type":"ContainerDied","Data":"5cf91789b8827b2d906623127728a0f8605a8999ff2b9c62889da8d9f270574b"} Aug 05 19:03:15.241474 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:15.241434 2578 scope.go:117] "RemoveContainer" containerID="5cf91789b8827b2d906623127728a0f8605a8999ff2b9c62889da8d9f270574b" Aug 05 19:03:16.247060 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:16.247023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-fw9fh" event={"ID":"204d3b96-53de-4c09-a0e6-d34122bb5488","Type":"ContainerStarted","Data":"f34a906a8b11b43f0b119ab73cb83ee99695802bb4c3158a071a25310d7beedc"} Aug 05 19:03:18.296028 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.295987 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" podUID="35699ceb-76c2-4a58-b5a2-abde7236b151" containerName="registry" containerID="cri-o://5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017" gracePeriod=30 Aug 05 19:03:18.579181 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.579148 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:03:18.731894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.731856 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtdg2\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-kube-api-access-dtdg2\") pod \"35699ceb-76c2-4a58-b5a2-abde7236b151\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " Aug 05 19:03:18.731894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.731903 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-bound-sa-token\") pod \"35699ceb-76c2-4a58-b5a2-abde7236b151\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " Aug 05 19:03:18.732142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.731924 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-certificates\") pod \"35699ceb-76c2-4a58-b5a2-abde7236b151\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " Aug 05 19:03:18.732142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.731940 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-installation-pull-secrets\") pod \"35699ceb-76c2-4a58-b5a2-abde7236b151\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " Aug 05 19:03:18.732142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.731960 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35699ceb-76c2-4a58-b5a2-abde7236b151-ca-trust-extracted\") pod \"35699ceb-76c2-4a58-b5a2-abde7236b151\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " Aug 05 19:03:18.732142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.732000 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-trusted-ca\") pod \"35699ceb-76c2-4a58-b5a2-abde7236b151\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " Aug 05 19:03:18.732142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.732036 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-image-registry-private-configuration\") pod \"35699ceb-76c2-4a58-b5a2-abde7236b151\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " Aug 05 19:03:18.732142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.732054 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") pod \"35699ceb-76c2-4a58-b5a2-abde7236b151\" (UID: \"35699ceb-76c2-4a58-b5a2-abde7236b151\") " Aug 05 19:03:18.732509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.732447 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "35699ceb-76c2-4a58-b5a2-abde7236b151" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:03:18.732653 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.732519 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "35699ceb-76c2-4a58-b5a2-abde7236b151" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:03:18.734661 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.734611 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "35699ceb-76c2-4a58-b5a2-abde7236b151" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 19:03:18.734661 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.734611 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "35699ceb-76c2-4a58-b5a2-abde7236b151" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:03:18.734862 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.734799 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-kube-api-access-dtdg2" (OuterVolumeSpecName: "kube-api-access-dtdg2") pod "35699ceb-76c2-4a58-b5a2-abde7236b151" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151"). InnerVolumeSpecName "kube-api-access-dtdg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:03:18.734948 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.734921 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "35699ceb-76c2-4a58-b5a2-abde7236b151" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 19:03:18.735001 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.734942 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "35699ceb-76c2-4a58-b5a2-abde7236b151" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:03:18.743548 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.743518 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35699ceb-76c2-4a58-b5a2-abde7236b151-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "35699ceb-76c2-4a58-b5a2-abde7236b151" (UID: "35699ceb-76c2-4a58-b5a2-abde7236b151"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:03:18.832638 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.832606 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtdg2\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-kube-api-access-dtdg2\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:03:18.832638 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.832639 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-bound-sa-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:03:18.832847 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.832648 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-certificates\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:03:18.832847 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.832657 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-installation-pull-secrets\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:03:18.832847 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.832668 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35699ceb-76c2-4a58-b5a2-abde7236b151-ca-trust-extracted\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:03:18.832847 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.832677 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35699ceb-76c2-4a58-b5a2-abde7236b151-trusted-ca\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:03:18.832847 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.832686 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35699ceb-76c2-4a58-b5a2-abde7236b151-image-registry-private-configuration\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:03:18.832847 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:18.832695 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35699ceb-76c2-4a58-b5a2-abde7236b151-registry-tls\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:03:19.262113 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.262021 2578 generic.go:356] "Generic (PLEG): container finished" podID="35699ceb-76c2-4a58-b5a2-abde7236b151" containerID="5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017" exitCode=0 Aug 05 19:03:19.262113 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.262070 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" Aug 05 19:03:19.262113 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.262088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" event={"ID":"35699ceb-76c2-4a58-b5a2-abde7236b151","Type":"ContainerDied","Data":"5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017"} Aug 05 19:03:19.262332 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.262128 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777fff4966-bxbgm" event={"ID":"35699ceb-76c2-4a58-b5a2-abde7236b151","Type":"ContainerDied","Data":"47d91715c40b8b2ed3947bcc657202842eddb70e147fd60be12fa787ac4563f9"} Aug 05 19:03:19.262332 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.262149 2578 scope.go:117] "RemoveContainer" containerID="5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017" Aug 05 19:03:19.270973 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.270947 2578 scope.go:117] "RemoveContainer" containerID="5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017" Aug 05 19:03:19.271333 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:03:19.271312 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017\": container with ID starting with 5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017 not found: ID does not exist" containerID="5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017" Aug 05 19:03:19.271389 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.271342 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017"} err="failed to get container status \"5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017\": rpc error: code = NotFound desc = could not find container \"5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017\": container with ID starting with 5e3dc6bf70236ad367456ab05da850830c989992019f2274699af619b4c7a017 not found: ID does not exist" Aug 05 19:03:19.287124 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.287087 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777fff4966-bxbgm"] Aug 05 19:03:19.290362 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:19.290332 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-777fff4966-bxbgm"] Aug 05 19:03:20.537466 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:20.537418 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35699ceb-76c2-4a58-b5a2-abde7236b151" path="/var/lib/kubelet/pods/35699ceb-76c2-4a58-b5a2-abde7236b151/volumes" Aug 05 19:03:22.281101 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:22.281060 2578 generic.go:356] "Generic (PLEG): container finished" podID="bf6127ab-0a56-4428-89a1-d982e927322f" containerID="e4d066248f9649aeafeff8b288755fedcf8024956e9bf49d5bc60d2fa2a3a895" exitCode=0 Aug 05 19:03:22.281625 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:22.281140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" event={"ID":"bf6127ab-0a56-4428-89a1-d982e927322f","Type":"ContainerDied","Data":"e4d066248f9649aeafeff8b288755fedcf8024956e9bf49d5bc60d2fa2a3a895"} Aug 05 19:03:22.281625 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:22.281566 2578 scope.go:117] "RemoveContainer" containerID="e4d066248f9649aeafeff8b288755fedcf8024956e9bf49d5bc60d2fa2a3a895" Aug 05 19:03:23.287212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:23.287174 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rch4b" event={"ID":"bf6127ab-0a56-4428-89a1-d982e927322f","Type":"ContainerStarted","Data":"fc28a773c0594641a54239ff7861eeff421e300fe862857cd1894a9fe9b0c6b5"} Aug 05 19:03:25.296933 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:25.296846 2578 generic.go:356] "Generic (PLEG): container finished" podID="00857821-0bae-44c3-a656-0033cc3c0cfc" containerID="e1a5da0bee614f6fc6b811156ca84cdc00b0111418fe1cbd5dd5a267ba84ab5f" exitCode=0 Aug 05 19:03:25.296933 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:25.296894 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kfhkc" event={"ID":"00857821-0bae-44c3-a656-0033cc3c0cfc","Type":"ContainerDied","Data":"e1a5da0bee614f6fc6b811156ca84cdc00b0111418fe1cbd5dd5a267ba84ab5f"} Aug 05 19:03:25.297312 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:25.297266 2578 scope.go:117] "RemoveContainer" containerID="e1a5da0bee614f6fc6b811156ca84cdc00b0111418fe1cbd5dd5a267ba84ab5f" Aug 05 19:03:26.303182 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:26.303145 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-kfhkc" event={"ID":"00857821-0bae-44c3-a656-0033cc3c0cfc","Type":"ContainerStarted","Data":"6735d99a83d81b88caf9bc36ebf6a7ee55f998d9d4ba470ae67c5e2da8db2fe4"} Aug 05 19:03:26.332072 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:26.332039 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f999d9fc6-fwg8z_c99440c4-09ca-4187-b83d-dedadb8ae375/router/0.log" Aug 05 19:03:26.347054 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:03:26.347024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fj2w_d9333206-a382-40f1-90ef-bfda175ba53d/serve-healthcheck-canary/0.log" Aug 05 19:06:14.406429 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:14.406398 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:06:14.408543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:14.408517 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:06:14.418380 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:14.418352 2578 kubelet.go:1648] "Image garbage collection succeeded" Aug 05 19:06:29.243061 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.243016 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr"] Aug 05 19:06:29.245578 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.243503 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35699ceb-76c2-4a58-b5a2-abde7236b151" containerName="registry" Aug 05 19:06:29.245578 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.243523 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="35699ceb-76c2-4a58-b5a2-abde7236b151" containerName="registry" Aug 05 19:06:29.245578 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.243583 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="35699ceb-76c2-4a58-b5a2-abde7236b151" containerName="registry" Aug 05 19:06:29.246544 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.246526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.249307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.249278 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Aug 05 19:06:29.249307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.249283 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 05 19:06:29.249541 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.249355 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rp8sm\"" Aug 05 19:06:29.249541 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.249372 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 05 19:06:29.249541 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.249486 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Aug 05 19:06:29.263483 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.263447 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr"] Aug 05 19:06:29.412156 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.412090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.412156 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.412157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc8mf\" (UniqueName: \"kubernetes.io/projected/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-kube-api-access-hc8mf\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.412414 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.412200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.412414 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.412256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.412414 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.412298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.513021 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.512930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.513021 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.512992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.513261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.513028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.513261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.513105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.513261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.513139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc8mf\" (UniqueName: \"kubernetes.io/projected/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-kube-api-access-hc8mf\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.513435 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.513409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-manifests\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.515580 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.515552 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-tmp\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.515706 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.515667 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.515802 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.515781 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.521173 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.521144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc8mf\" (UniqueName: \"kubernetes.io/projected/330a15fc-05a9-43cd-9252-2e5b7a38a9c7-kube-api-access-hc8mf\") pod \"opendatahub-operator-controller-manager-74df9bd579-h8cmr\" (UID: \"330a15fc-05a9-43cd-9252-2e5b7a38a9c7\") " pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.557962 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.557919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:29.703224 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.703195 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr"] Aug 05 19:06:29.705253 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:06:29.705215 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330a15fc_05a9_43cd_9252_2e5b7a38a9c7.slice/crio-2c20183d3aad52c1dca02ae29083096013703a41a0e62315ccb2b59ce1180157 WatchSource:0}: Error finding container 2c20183d3aad52c1dca02ae29083096013703a41a0e62315ccb2b59ce1180157: Status 404 returned error can't find the container with id 2c20183d3aad52c1dca02ae29083096013703a41a0e62315ccb2b59ce1180157 Aug 05 19:06:29.706965 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:29.706942 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 19:06:30.039489 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:30.039453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" event={"ID":"330a15fc-05a9-43cd-9252-2e5b7a38a9c7","Type":"ContainerStarted","Data":"2c20183d3aad52c1dca02ae29083096013703a41a0e62315ccb2b59ce1180157"} Aug 05 19:06:33.057524 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:33.057487 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" event={"ID":"330a15fc-05a9-43cd-9252-2e5b7a38a9c7","Type":"ContainerStarted","Data":"464d02f5c2fa173dba1ff0e8bf17de6416b70a462bc99e661ddc602570f37a45"} Aug 05 19:06:34.063121 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:34.063084 2578 generic.go:356] "Generic (PLEG): container finished" podID="330a15fc-05a9-43cd-9252-2e5b7a38a9c7" containerID="464d02f5c2fa173dba1ff0e8bf17de6416b70a462bc99e661ddc602570f37a45" exitCode=0 Aug 05 19:06:34.063590 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:34.063140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" event={"ID":"330a15fc-05a9-43cd-9252-2e5b7a38a9c7","Type":"ContainerDied","Data":"464d02f5c2fa173dba1ff0e8bf17de6416b70a462bc99e661ddc602570f37a45"} Aug 05 19:06:35.070399 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:35.070348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" event={"ID":"330a15fc-05a9-43cd-9252-2e5b7a38a9c7","Type":"ContainerStarted","Data":"fe5193349dbff1707709c3628bc4ce3b21a56b403661b32f2e3eaafe18caf1ce"} Aug 05 19:06:35.070922 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:35.070550 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:35.091942 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:35.091890 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" podStartSLOduration=1.827907707 podStartE2EDuration="6.091868083s" totalImagesPullingTime="3.254421837s" totalInitContainerRuntime="1.009538539s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:06:35.08991268 +0000 UTC m=+321.109975729" watchObservedRunningTime="2026-08-05 19:06:35.091868083 +0000 UTC m=+321.111931199" Aug 05 19:06:46.082511 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:46.082472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74df9bd579-h8cmr" Aug 05 19:06:48.963333 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:48.963290 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wfz5w"] Aug 05 19:06:48.975240 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:48.975210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:48.978866 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:48.978838 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wpvs5\"" Aug 05 19:06:48.979001 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:48.978948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Aug 05 19:06:48.986938 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:48.986913 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wfz5w"] Aug 05 19:06:49.066466 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.066417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xxc\" (UniqueName: \"kubernetes.io/projected/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-kube-api-access-24xxc\") pod \"odh-model-controller-7998c67dc4-wfz5w\" (UID: \"fcfe9f9c-c9d6-4247-a62e-93ae5d987975\") " pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:49.066636 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.066515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-cert\") pod \"odh-model-controller-7998c67dc4-wfz5w\" (UID: \"fcfe9f9c-c9d6-4247-a62e-93ae5d987975\") " pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:49.167375 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.167323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24xxc\" (UniqueName: \"kubernetes.io/projected/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-kube-api-access-24xxc\") pod \"odh-model-controller-7998c67dc4-wfz5w\" (UID: \"fcfe9f9c-c9d6-4247-a62e-93ae5d987975\") " pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:49.167593 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.167423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-cert\") pod \"odh-model-controller-7998c67dc4-wfz5w\" (UID: \"fcfe9f9c-c9d6-4247-a62e-93ae5d987975\") " pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:49.167656 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:06:49.167589 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Aug 05 19:06:49.167708 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:06:49.167680 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-cert podName:fcfe9f9c-c9d6-4247-a62e-93ae5d987975 nodeName:}" failed. No retries permitted until 2026-08-05 19:06:49.667657212 +0000 UTC m=+335.687720247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-cert") pod "odh-model-controller-7998c67dc4-wfz5w" (UID: "fcfe9f9c-c9d6-4247-a62e-93ae5d987975") : secret "odh-model-controller-webhook-cert" not found Aug 05 19:06:49.178259 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.178221 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xxc\" (UniqueName: \"kubernetes.io/projected/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-kube-api-access-24xxc\") pod \"odh-model-controller-7998c67dc4-wfz5w\" (UID: \"fcfe9f9c-c9d6-4247-a62e-93ae5d987975\") " pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:49.606810 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.606775 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9fdgf"] Aug 05 19:06:49.610206 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.610188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:49.615956 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.615924 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Aug 05 19:06:49.616110 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.616054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-88bk5\"" Aug 05 19:06:49.622365 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.622333 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9fdgf"] Aug 05 19:06:49.671560 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.671510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-cert\") pod \"odh-model-controller-7998c67dc4-wfz5w\" (UID: \"fcfe9f9c-c9d6-4247-a62e-93ae5d987975\") " pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:49.671560 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.671567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86s7h\" (UniqueName: \"kubernetes.io/projected/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-kube-api-access-86s7h\") pod \"model-serving-api-54d89bd5fc-9fdgf\" (UID: \"2921cc43-3457-4eb8-8fa4-3e736f01b6f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:49.671861 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.671691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-9fdgf\" (UID: \"2921cc43-3457-4eb8-8fa4-3e736f01b6f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:49.674182 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.674158 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcfe9f9c-c9d6-4247-a62e-93ae5d987975-cert\") pod \"odh-model-controller-7998c67dc4-wfz5w\" (UID: \"fcfe9f9c-c9d6-4247-a62e-93ae5d987975\") " pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:49.772426 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.772383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86s7h\" (UniqueName: \"kubernetes.io/projected/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-kube-api-access-86s7h\") pod \"model-serving-api-54d89bd5fc-9fdgf\" (UID: \"2921cc43-3457-4eb8-8fa4-3e736f01b6f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:49.772426 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.772425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-9fdgf\" (UID: \"2921cc43-3457-4eb8-8fa4-3e736f01b6f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:49.772642 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:06:49.772530 2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Aug 05 19:06:49.772642 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:06:49.772586 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-tls-certs podName:2921cc43-3457-4eb8-8fa4-3e736f01b6f4 nodeName:}" failed. No retries permitted until 2026-08-05 19:06:50.272570143 +0000 UTC m=+336.292633169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-tls-certs") pod "model-serving-api-54d89bd5fc-9fdgf" (UID: "2921cc43-3457-4eb8-8fa4-3e736f01b6f4") : secret "model-serving-api-tls" not found Aug 05 19:06:49.783829 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.783801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86s7h\" (UniqueName: \"kubernetes.io/projected/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-kube-api-access-86s7h\") pod \"model-serving-api-54d89bd5fc-9fdgf\" (UID: \"2921cc43-3457-4eb8-8fa4-3e736f01b6f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:49.885858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:49.885740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:50.029604 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:50.029577 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wfz5w"] Aug 05 19:06:50.032571 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:06:50.032542 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfe9f9c_c9d6_4247_a62e_93ae5d987975.slice/crio-768331cf99e1e4014075f836d7c795a750c4acb7e44c52a5cba5ddd20b0e1b39 WatchSource:0}: Error finding container 768331cf99e1e4014075f836d7c795a750c4acb7e44c52a5cba5ddd20b0e1b39: Status 404 returned error can't find the container with id 768331cf99e1e4014075f836d7c795a750c4acb7e44c52a5cba5ddd20b0e1b39 Aug 05 19:06:50.145697 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:50.145599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" event={"ID":"fcfe9f9c-c9d6-4247-a62e-93ae5d987975","Type":"ContainerStarted","Data":"768331cf99e1e4014075f836d7c795a750c4acb7e44c52a5cba5ddd20b0e1b39"} Aug 05 19:06:50.276723 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:50.276671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-9fdgf\" (UID: \"2921cc43-3457-4eb8-8fa4-3e736f01b6f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:50.279152 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:50.279123 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2921cc43-3457-4eb8-8fa4-3e736f01b6f4-tls-certs\") pod \"model-serving-api-54d89bd5fc-9fdgf\" (UID: \"2921cc43-3457-4eb8-8fa4-3e736f01b6f4\") " pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:50.521674 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:50.521572 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:50.662957 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:50.662918 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9fdgf"] Aug 05 19:06:50.665695 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:06:50.665660 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2921cc43_3457_4eb8_8fa4_3e736f01b6f4.slice/crio-c87b402e6e7eb720ffb5d090dd6d3614f73b79a2893c6150ccfab1dfbe9e729a WatchSource:0}: Error finding container c87b402e6e7eb720ffb5d090dd6d3614f73b79a2893c6150ccfab1dfbe9e729a: Status 404 returned error can't find the container with id c87b402e6e7eb720ffb5d090dd6d3614f73b79a2893c6150ccfab1dfbe9e729a Aug 05 19:06:51.153102 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:51.153058 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" event={"ID":"2921cc43-3457-4eb8-8fa4-3e736f01b6f4","Type":"ContainerStarted","Data":"c87b402e6e7eb720ffb5d090dd6d3614f73b79a2893c6150ccfab1dfbe9e729a"} Aug 05 19:06:54.174126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:54.173810 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" event={"ID":"fcfe9f9c-c9d6-4247-a62e-93ae5d987975","Type":"ContainerStarted","Data":"e1b42cf5fe5e8aa02c385bfee6c5b26ed67d3465b57439fe7541667428f8fb79"} Aug 05 19:06:54.174126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:54.173947 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:06:54.190182 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:54.189550 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" podStartSLOduration=3.080839925 podStartE2EDuration="6.189530081s" totalImagesPullingTime="3.108690156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:06:54.188554377 +0000 UTC m=+340.208617425" watchObservedRunningTime="2026-08-05 19:06:54.189530081 +0000 UTC m=+340.209593127" Aug 05 19:06:56.187858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:56.187818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" event={"ID":"2921cc43-3457-4eb8-8fa4-3e736f01b6f4","Type":"ContainerStarted","Data":"33ec025699eff15546d2f3840a07355450d7c5557d2f404e3203609f3f19d386"} Aug 05 19:06:56.188326 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:56.187911 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:06:56.220101 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:56.220039 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" podStartSLOduration=2.543840467 podStartE2EDuration="7.220020255s" totalImagesPullingTime="4.676179788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:06:56.218446819 +0000 UTC m=+342.238509867" watchObservedRunningTime="2026-08-05 19:06:56.220020255 +0000 UTC m=+342.240083349" Aug 05 19:06:59.213223 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.213181 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w47bn"] Aug 05 19:06:59.216427 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.216394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:06:59.219239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.219214 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Aug 05 19:06:59.219607 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.219415 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7"] Aug 05 19:06:59.219838 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.219596 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qxqpj\"" Aug 05 19:06:59.223500 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.223426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:06:59.227142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.227118 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gcj4j\"" Aug 05 19:06:59.227439 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.227420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Aug 05 19:06:59.227508 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.227490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w47bn"] Aug 05 19:06:59.233968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.233936 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7"] Aug 05 19:06:59.258978 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.258938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwr5d\" (UniqueName: \"kubernetes.io/projected/a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8-kube-api-access-vwr5d\") pod \"llmisvc-controller-manager-777c6bd7d5-jmbq7\" (UID: \"a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:06:59.259187 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.259097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzn8\" (UniqueName: \"kubernetes.io/projected/5d95a646-511a-4535-a12e-47e8f8c0eb3b-kube-api-access-nbzn8\") pod \"kserve-controller-manager-d6f4b65b8-w47bn\" (UID: \"5d95a646-511a-4535-a12e-47e8f8c0eb3b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:06:59.259187 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.259155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d95a646-511a-4535-a12e-47e8f8c0eb3b-cert\") pod \"kserve-controller-manager-d6f4b65b8-w47bn\" (UID: \"5d95a646-511a-4535-a12e-47e8f8c0eb3b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:06:59.259279 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.259203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jmbq7\" (UID: \"a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:06:59.360526 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.360489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d95a646-511a-4535-a12e-47e8f8c0eb3b-cert\") pod \"kserve-controller-manager-d6f4b65b8-w47bn\" (UID: \"5d95a646-511a-4535-a12e-47e8f8c0eb3b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:06:59.360770 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.360537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jmbq7\" (UID: \"a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:06:59.360770 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.360567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwr5d\" (UniqueName: \"kubernetes.io/projected/a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8-kube-api-access-vwr5d\") pod \"llmisvc-controller-manager-777c6bd7d5-jmbq7\" (UID: \"a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:06:59.360770 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.360638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzn8\" (UniqueName: \"kubernetes.io/projected/5d95a646-511a-4535-a12e-47e8f8c0eb3b-kube-api-access-nbzn8\") pod \"kserve-controller-manager-d6f4b65b8-w47bn\" (UID: \"5d95a646-511a-4535-a12e-47e8f8c0eb3b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:06:59.360770 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:06:59.360658 2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Aug 05 19:06:59.360770 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:06:59.360763 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d95a646-511a-4535-a12e-47e8f8c0eb3b-cert podName:5d95a646-511a-4535-a12e-47e8f8c0eb3b nodeName:}" failed. No retries permitted until 2026-08-05 19:06:59.860726266 +0000 UTC m=+345.880789308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5d95a646-511a-4535-a12e-47e8f8c0eb3b-cert") pod "kserve-controller-manager-d6f4b65b8-w47bn" (UID: "5d95a646-511a-4535-a12e-47e8f8c0eb3b") : secret "kserve-webhook-server-cert" not found Aug 05 19:06:59.363813 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.363781 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jmbq7\" (UID: \"a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:06:59.379451 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.379415 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzn8\" (UniqueName: \"kubernetes.io/projected/5d95a646-511a-4535-a12e-47e8f8c0eb3b-kube-api-access-nbzn8\") pod \"kserve-controller-manager-d6f4b65b8-w47bn\" (UID: \"5d95a646-511a-4535-a12e-47e8f8c0eb3b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:06:59.383431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.383402 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwr5d\" (UniqueName: \"kubernetes.io/projected/a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8-kube-api-access-vwr5d\") pod \"llmisvc-controller-manager-777c6bd7d5-jmbq7\" (UID: \"a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:06:59.453016 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.452982 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5"] Aug 05 19:06:59.456772 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.456733 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.463897 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.463813 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Aug 05 19:06:59.463897 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.463837 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Aug 05 19:06:59.487110 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.487075 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5"] Aug 05 19:06:59.545695 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.545649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:06:59.562488 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.562430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmk4\" (UniqueName: \"kubernetes.io/projected/8122e435-32ab-434a-914d-835ac22f1007-kube-api-access-mpmk4\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.562647 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.562567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8122e435-32ab-434a-914d-835ac22f1007-tmp\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.562647 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.562607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.664042 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.663994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmk4\" (UniqueName: \"kubernetes.io/projected/8122e435-32ab-434a-914d-835ac22f1007-kube-api-access-mpmk4\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.664225 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.664139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8122e435-32ab-434a-914d-835ac22f1007-tmp\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.664225 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.664177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.664433 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:06:59.664411 2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Aug 05 19:06:59.664510 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:06:59.664488 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs podName:8122e435-32ab-434a-914d-835ac22f1007 nodeName:}" failed. No retries permitted until 2026-08-05 19:07:00.164466351 +0000 UTC m=+346.184529397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs") pod "kube-auth-proxy-5556bf7c7c-j94d5" (UID: "8122e435-32ab-434a-914d-835ac22f1007") : secret "kube-auth-proxy-tls" not found Aug 05 19:06:59.666510 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.666476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8122e435-32ab-434a-914d-835ac22f1007-tmp\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.675672 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.675644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmk4\" (UniqueName: \"kubernetes.io/projected/8122e435-32ab-434a-914d-835ac22f1007-kube-api-access-mpmk4\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:06:59.696314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.696282 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7"] Aug 05 19:06:59.699043 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:06:59.699011 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda9eb8e05_83e4_45ff_9a62_6e8a72fb40b8.slice/crio-e0ba989f108b8cc6ddbbbf642d5db8b1803ba43fb0928fb11828f1073bdca0c4 WatchSource:0}: Error finding container e0ba989f108b8cc6ddbbbf642d5db8b1803ba43fb0928fb11828f1073bdca0c4: Status 404 returned error can't find the container with id e0ba989f108b8cc6ddbbbf642d5db8b1803ba43fb0928fb11828f1073bdca0c4 Aug 05 19:06:59.866516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.866465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d95a646-511a-4535-a12e-47e8f8c0eb3b-cert\") pod \"kserve-controller-manager-d6f4b65b8-w47bn\" (UID: \"5d95a646-511a-4535-a12e-47e8f8c0eb3b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:06:59.869007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:06:59.868983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d95a646-511a-4535-a12e-47e8f8c0eb3b-cert\") pod \"kserve-controller-manager-d6f4b65b8-w47bn\" (UID: \"5d95a646-511a-4535-a12e-47e8f8c0eb3b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:07:00.135338 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:00.135242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:07:00.169823 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:00.169785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:07:00.169997 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:07:00.169968 2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Aug 05 19:07:00.170063 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:07:00.170050 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs podName:8122e435-32ab-434a-914d-835ac22f1007 nodeName:}" failed. No retries permitted until 2026-08-05 19:07:01.17003042 +0000 UTC m=+347.190093451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs") pod "kube-auth-proxy-5556bf7c7c-j94d5" (UID: "8122e435-32ab-434a-914d-835ac22f1007") : secret "kube-auth-proxy-tls" not found Aug 05 19:07:00.221825 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:00.221788 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" event={"ID":"a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8","Type":"ContainerStarted","Data":"e0ba989f108b8cc6ddbbbf642d5db8b1803ba43fb0928fb11828f1073bdca0c4"} Aug 05 19:07:00.311328 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:00.310356 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w47bn"] Aug 05 19:07:00.319347 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:07:00.319304 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d95a646_511a_4535_a12e_47e8f8c0eb3b.slice/crio-4e5e1303d2fc5dca5974dd18ff8d6ce1f1358435645acd791d4a50393bbe32d2 WatchSource:0}: Error finding container 4e5e1303d2fc5dca5974dd18ff8d6ce1f1358435645acd791d4a50393bbe32d2: Status 404 returned error can't find the container with id 4e5e1303d2fc5dca5974dd18ff8d6ce1f1358435645acd791d4a50393bbe32d2 Aug 05 19:07:01.180370 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:01.180336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:07:01.183073 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:01.183044 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8122e435-32ab-434a-914d-835ac22f1007-tls-certs\") pod \"kube-auth-proxy-5556bf7c7c-j94d5\" (UID: \"8122e435-32ab-434a-914d-835ac22f1007\") " pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:07:01.243779 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:01.243492 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" event={"ID":"5d95a646-511a-4535-a12e-47e8f8c0eb3b","Type":"ContainerStarted","Data":"4e5e1303d2fc5dca5974dd18ff8d6ce1f1358435645acd791d4a50393bbe32d2"} Aug 05 19:07:01.268453 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:01.268155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" Aug 05 19:07:01.926356 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:01.926326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5"] Aug 05 19:07:01.927639 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:07:01.927610 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8122e435_32ab_434a_914d_835ac22f1007.slice/crio-08da099ca9c9bccb8fc2c2f4a4cadc6a3e986c9e25568dd6aa6d0a7c9234a556 WatchSource:0}: Error finding container 08da099ca9c9bccb8fc2c2f4a4cadc6a3e986c9e25568dd6aa6d0a7c9234a556: Status 404 returned error can't find the container with id 08da099ca9c9bccb8fc2c2f4a4cadc6a3e986c9e25568dd6aa6d0a7c9234a556 Aug 05 19:07:02.256658 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:02.256604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" event={"ID":"8122e435-32ab-434a-914d-835ac22f1007","Type":"ContainerStarted","Data":"08da099ca9c9bccb8fc2c2f4a4cadc6a3e986c9e25568dd6aa6d0a7c9234a556"} Aug 05 19:07:03.265141 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:03.265096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" event={"ID":"5d95a646-511a-4535-a12e-47e8f8c0eb3b","Type":"ContainerStarted","Data":"62c4c2ad3ed2dcfbfa38f6900f30ba6a5fb568b241ec55be3602f94212928950"} Aug 05 19:07:03.265618 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:03.265386 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:07:03.287272 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:03.287211 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" podStartSLOduration=1.478111835 podStartE2EDuration="4.287192808s" totalImagesPullingTime="2.809080973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:07:03.285184255 +0000 UTC m=+349.305247303" watchObservedRunningTime="2026-08-05 19:07:03.287192808 +0000 UTC m=+349.307255855" Aug 05 19:07:05.183053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.183020 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wfz5w" Aug 05 19:07:05.277166 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.277122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" event={"ID":"8122e435-32ab-434a-914d-835ac22f1007","Type":"ContainerStarted","Data":"64819cd8fdf6398590d828a65c4bb9ead915478c0c45584a67362d146359f729"} Aug 05 19:07:05.278734 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.278707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" event={"ID":"a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8","Type":"ContainerStarted","Data":"109f43f98e112bcd708838485eb7948ca047c1b26c15457980c0e94e78e823ab"} Aug 05 19:07:05.278872 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.278781 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:07:05.293341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.293186 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5556bf7c7c-j94d5" podStartSLOduration=3.754957863 podStartE2EDuration="6.293164824s" totalImagesPullingTime="2.538206961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:07:05.292532052 +0000 UTC m=+351.312595097" watchObservedRunningTime="2026-08-05 19:07:05.293164824 +0000 UTC m=+351.313227873" Aug 05 19:07:05.313098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.313031 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" podStartSLOduration=1.54862736 podStartE2EDuration="6.313007041s" totalImagesPullingTime="4.764379681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:07:05.312141723 +0000 UTC m=+351.332204772" watchObservedRunningTime="2026-08-05 19:07:05.313007041 +0000 UTC m=+351.333070089" Aug 05 19:07:05.850924 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.850875 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7"] Aug 05 19:07:05.854951 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.854922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.857685 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.857658 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Aug 05 19:07:05.857833 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.857658 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9prqg\"" Aug 05 19:07:05.865190 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.865116 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7"] Aug 05 19:07:05.906398 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.906366 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45"] Aug 05 19:07:05.910026 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.910000 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:05.921629 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.921602 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45"] Aug 05 19:07:05.925002 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.924977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.925150 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.925007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.925150 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.925034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880a3284-014e-4704-89d4-f78aaad87887-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.925150 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.925062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.925150 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.925091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.925150 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.925146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880a3284-014e-4704-89d4-f78aaad87887-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.925403 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.925226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.925403 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.925251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:05.925403 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:05.925313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxh77\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-kube-api-access-xxh77\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.026807 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.026764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880a3284-014e-4704-89d4-f78aaad87887-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027011 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.026819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66414737-9c6f-4d6e-9010-05de5acd7884-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027011 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.026852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027011 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.026884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027011 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.026917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027011 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.026950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9czc7\" (UniqueName: \"kubernetes.io/projected/66414737-9c6f-4d6e-9010-05de5acd7884-kube-api-access-9czc7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027011 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.026990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880a3284-014e-4704-89d4-f78aaad87887-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027285 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027285 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027285 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027285 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66414737-9c6f-4d6e-9010-05de5acd7884-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027285 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027598 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027598 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66414737-9c6f-4d6e-9010-05de5acd7884-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027598 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027408 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027598 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxh77\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-kube-api-access-xxh77\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027598 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.027598 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027598 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027961 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027653 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880a3284-014e-4704-89d4-f78aaad87887-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.027961 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.027791 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.028098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.028080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.028153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.028081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.029760 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.029720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.029858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.029788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880a3284-014e-4704-89d4-f78aaad87887-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.040027 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.039998 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxh77\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-kube-api-access-xxh77\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.040385 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.040363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.128488 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66414737-9c6f-4d6e-9010-05de5acd7884-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.128488 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.128488 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.128791 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66414737-9c6f-4d6e-9010-05de5acd7884-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.128791 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.128791 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66414737-9c6f-4d6e-9010-05de5acd7884-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.128791 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.128791 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9czc7\" (UniqueName: \"kubernetes.io/projected/66414737-9c6f-4d6e-9010-05de5acd7884-kube-api-access-9czc7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.128791 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.128712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.129206 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.129166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.129206 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.129185 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.129742 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.129225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66414737-9c6f-4d6e-9010-05de5acd7884-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.129742 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.129690 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.129742 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.129696 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.131781 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.131732 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66414737-9c6f-4d6e-9010-05de5acd7884-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.132015 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.131991 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66414737-9c6f-4d6e-9010-05de5acd7884-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.142877 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.142844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66414737-9c6f-4d6e-9010-05de5acd7884-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.143126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.143103 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9czc7\" (UniqueName: \"kubernetes.io/projected/66414737-9c6f-4d6e-9010-05de5acd7884-kube-api-access-9czc7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp6j45\" (UID: \"66414737-9c6f-4d6e-9010-05de5acd7884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.167288 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.167249 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:06.220227 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.220008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:06.338058 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.337938 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7"] Aug 05 19:07:06.401270 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:06.401244 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45"] Aug 05 19:07:06.403420 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:07:06.403377 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66414737_9c6f_4d6e_9010_05de5acd7884.slice/crio-c8723e30b8e689955fabb034310863accc0d77eb7568cc835cef9243fcae3f89 WatchSource:0}: Error finding container c8723e30b8e689955fabb034310863accc0d77eb7568cc835cef9243fcae3f89: Status 404 returned error can't find the container with id c8723e30b8e689955fabb034310863accc0d77eb7568cc835cef9243fcae3f89 Aug 05 19:07:07.203959 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:07.202982 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-9fdgf" Aug 05 19:07:07.300544 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:07.300507 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" event={"ID":"880a3284-014e-4704-89d4-f78aaad87887","Type":"ContainerStarted","Data":"56e7761dd8a10a6a798594fe625d66640e81b5c1434e1d5aaaf12936951720db"} Aug 05 19:07:07.303465 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:07.303379 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" event={"ID":"66414737-9c6f-4d6e-9010-05de5acd7884","Type":"ContainerStarted","Data":"c8723e30b8e689955fabb034310863accc0d77eb7568cc835cef9243fcae3f89"} Aug 05 19:07:09.516136 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:09.516093 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:07:09.516445 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:09.516174 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:07:09.516445 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:09.516206 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:07:09.530213 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:09.530178 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:07:09.530344 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:09.530254 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:07:09.530344 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:09.530291 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:07:10.320034 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:10.319995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" event={"ID":"880a3284-014e-4704-89d4-f78aaad87887","Type":"ContainerStarted","Data":"3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f"} Aug 05 19:07:10.321485 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:10.321416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" event={"ID":"66414737-9c6f-4d6e-9010-05de5acd7884","Type":"ContainerStarted","Data":"67c1bea0164a0cba81a34bc25b96571c8ab4008579781009dbcfb7bbf7fb2567"} Aug 05 19:07:10.340054 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:10.339988 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" podStartSLOduration=2.154724066 podStartE2EDuration="5.339964364s" totalImagesPullingTime="3.185240298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:07:10.337623791 +0000 UTC m=+356.357686846" watchObservedRunningTime="2026-08-05 19:07:10.339964364 +0000 UTC m=+356.360027413" Aug 05 19:07:10.356282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:10.356225 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" podStartSLOduration=2.246811377 podStartE2EDuration="5.356206319s" totalImagesPullingTime="3.109394942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:07:10.354179099 +0000 UTC m=+356.374242149" watchObservedRunningTime="2026-08-05 19:07:10.356206319 +0000 UTC m=+356.376269366" Aug 05 19:07:11.168103 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:11.168067 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:11.169402 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:11.169372 2578 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Aug 05 19:07:11.169476 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:11.169430 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" podUID="880a3284-014e-4704-89d4-f78aaad87887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Aug 05 19:07:11.220728 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:11.220685 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:11.225597 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:11.225566 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:11.327044 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:11.327010 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:11.327966 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:11.327945 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp6j45" Aug 05 19:07:11.371155 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:11.371117 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7"] Aug 05 19:07:12.168175 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:12.168127 2578 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Aug 05 19:07:12.168560 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:12.168204 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" podUID="880a3284-014e-4704-89d4-f78aaad87887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Aug 05 19:07:13.168069 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:13.168027 2578 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body= Aug 05 19:07:13.168256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:13.168093 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" podUID="880a3284-014e-4704-89d4-f78aaad87887" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" Aug 05 19:07:13.335786 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:13.335730 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" podUID="880a3284-014e-4704-89d4-f78aaad87887" containerName="istio-proxy" containerID="cri-o://3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f" gracePeriod=30 Aug 05 19:07:18.584873 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.584844 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:18.752920 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.752821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-credential-socket\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.752920 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.752874 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-socket\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.752920 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.752911 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-istio-token\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.753209 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.752976 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880a3284-014e-4704-89d4-f78aaad87887-istio-podinfo\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.753209 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.752996 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-envoy\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.753209 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753015 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-certs\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.753209 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753031 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-data\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.753209 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753067 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxh77\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-kube-api-access-xxh77\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.753485 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753166 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:07:18.753485 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753252 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:07:18.753485 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753266 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880a3284-014e-4704-89d4-f78aaad87887-istiod-ca-cert\") pod \"880a3284-014e-4704-89d4-f78aaad87887\" (UID: \"880a3284-014e-4704-89d4-f78aaad87887\") " Aug 05 19:07:18.753625 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753504 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-data" (OuterVolumeSpecName: "istio-data") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:07:18.753625 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753593 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:07:18.753625 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753609 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:18.753816 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753629 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:18.753816 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753644 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:18.753816 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.753717 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/880a3284-014e-4704-89d4-f78aaad87887-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:07:18.755485 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.755454 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/880a3284-014e-4704-89d4-f78aaad87887-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:07:18.755585 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.755460 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:07:18.755679 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.755654 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-istio-token" (OuterVolumeSpecName: "istio-token") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:07:18.755792 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.755728 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-kube-api-access-xxh77" (OuterVolumeSpecName: "kube-api-access-xxh77") pod "880a3284-014e-4704-89d4-f78aaad87887" (UID: "880a3284-014e-4704-89d4-f78aaad87887"). InnerVolumeSpecName "kube-api-access-xxh77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:07:18.854293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.854251 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/880a3284-014e-4704-89d4-f78aaad87887-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:18.854293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.854287 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:18.854293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.854298 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/880a3284-014e-4704-89d4-f78aaad87887-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:18.854528 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.854309 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxh77\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-kube-api-access-xxh77\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:18.854528 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.854320 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/880a3284-014e-4704-89d4-f78aaad87887-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:18.854528 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:18.854328 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880a3284-014e-4704-89d4-f78aaad87887-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:07:19.363427 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.363395 2578 generic.go:356] "Generic (PLEG): container finished" podID="880a3284-014e-4704-89d4-f78aaad87887" containerID="3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f" exitCode=0 Aug 05 19:07:19.363588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.363443 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" Aug 05 19:07:19.363588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.363457 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" event={"ID":"880a3284-014e-4704-89d4-f78aaad87887","Type":"ContainerDied","Data":"3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f"} Aug 05 19:07:19.363588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.363503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7" event={"ID":"880a3284-014e-4704-89d4-f78aaad87887","Type":"ContainerDied","Data":"56e7761dd8a10a6a798594fe625d66640e81b5c1434e1d5aaaf12936951720db"} Aug 05 19:07:19.363588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.363525 2578 scope.go:117] "RemoveContainer" containerID="3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f" Aug 05 19:07:19.373158 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.373130 2578 scope.go:117] "RemoveContainer" containerID="3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f" Aug 05 19:07:19.373484 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:07:19.373465 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f\": container with ID starting with 3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f not found: ID does not exist" containerID="3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f" Aug 05 19:07:19.373524 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.373504 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f"} err="failed to get container status \"3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f\": rpc error: code = NotFound desc = could not find container \"3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f\": container with ID starting with 3c13ab2cf59dec78bb0bbb2ae3856a81cf977397f129ebc41eefcf521dc20b6f not found: ID does not exist" Aug 05 19:07:19.385071 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.385042 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7"] Aug 05 19:07:19.389434 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:19.389405 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-gh4w7"] Aug 05 19:07:20.537894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:20.537858 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="880a3284-014e-4704-89d4-f78aaad87887" path="/var/lib/kubelet/pods/880a3284-014e-4704-89d4-f78aaad87887/volumes" Aug 05 19:07:34.275902 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:34.275870 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w47bn" Aug 05 19:07:36.293901 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:07:36.293866 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jmbq7" Aug 05 19:08:11.178205 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.178161 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m"] Aug 05 19:08:11.178731 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.178606 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="880a3284-014e-4704-89d4-f78aaad87887" containerName="istio-proxy" Aug 05 19:08:11.178731 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.178622 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="880a3284-014e-4704-89d4-f78aaad87887" containerName="istio-proxy" Aug 05 19:08:11.178731 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.178684 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="880a3284-014e-4704-89d4-f78aaad87887" containerName="istio-proxy" Aug 05 19:08:11.181800 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.181781 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" Aug 05 19:08:11.184293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.184267 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 05 19:08:11.184293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.184288 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 05 19:08:11.184537 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.184522 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Aug 05 19:08:11.184709 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.184692 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4ncbt\"" Aug 05 19:08:11.190829 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.190804 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m"] Aug 05 19:08:11.321556 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.321519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4n97\" (UniqueName: \"kubernetes.io/projected/7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7-kube-api-access-l4n97\") pod \"dns-operator-controller-manager-5985564776-f5z4m\" (UID: \"7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" Aug 05 19:08:11.422179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.422137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4n97\" (UniqueName: \"kubernetes.io/projected/7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7-kube-api-access-l4n97\") pod \"dns-operator-controller-manager-5985564776-f5z4m\" (UID: \"7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" Aug 05 19:08:11.430488 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.430419 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4n97\" (UniqueName: \"kubernetes.io/projected/7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7-kube-api-access-l4n97\") pod \"dns-operator-controller-manager-5985564776-f5z4m\" (UID: \"7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" Aug 05 19:08:11.493241 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.493204 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" Aug 05 19:08:11.634536 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:11.634512 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m"] Aug 05 19:08:11.637133 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:08:11.637105 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3447a1_bd73_49e8_a4f0_6e1c9a7b4ae7.slice/crio-0ac490d287b48a250c89e741e4b8882e17ea646e3c3b07b14f68485d214b2d3a WatchSource:0}: Error finding container 0ac490d287b48a250c89e741e4b8882e17ea646e3c3b07b14f68485d214b2d3a: Status 404 returned error can't find the container with id 0ac490d287b48a250c89e741e4b8882e17ea646e3c3b07b14f68485d214b2d3a Aug 05 19:08:12.613021 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:12.612971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" event={"ID":"7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7","Type":"ContainerStarted","Data":"0ac490d287b48a250c89e741e4b8882e17ea646e3c3b07b14f68485d214b2d3a"} Aug 05 19:08:13.185815 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:13.185776 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6"] Aug 05 19:08:13.190042 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:13.190013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:13.192727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:13.192704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9zhvt\"" Aug 05 19:08:13.197666 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:13.197616 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6"] Aug 05 19:08:13.236638 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:13.236599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wplm\" (UniqueName: \"kubernetes.io/projected/8da2f257-830a-4b03-a3db-3deb3cb48c2d-kube-api-access-7wplm\") pod \"limitador-operator-controller-manager-6c549b6d85-h7hs6\" (UID: \"8da2f257-830a-4b03-a3db-3deb3cb48c2d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:13.338055 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:13.338006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wplm\" (UniqueName: \"kubernetes.io/projected/8da2f257-830a-4b03-a3db-3deb3cb48c2d-kube-api-access-7wplm\") pod \"limitador-operator-controller-manager-6c549b6d85-h7hs6\" (UID: \"8da2f257-830a-4b03-a3db-3deb3cb48c2d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:13.346504 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:13.346473 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wplm\" (UniqueName: \"kubernetes.io/projected/8da2f257-830a-4b03-a3db-3deb3cb48c2d-kube-api-access-7wplm\") pod \"limitador-operator-controller-manager-6c549b6d85-h7hs6\" (UID: \"8da2f257-830a-4b03-a3db-3deb3cb48c2d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:13.505270 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:13.505183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:14.384367 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:14.384331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6"] Aug 05 19:08:14.386178 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:08:14.386148 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da2f257_830a_4b03_a3db_3deb3cb48c2d.slice/crio-0b4b61168f9a51b821b88c3b8d35508066906d2b97774ba447e2b2c367604516 WatchSource:0}: Error finding container 0b4b61168f9a51b821b88c3b8d35508066906d2b97774ba447e2b2c367604516: Status 404 returned error can't find the container with id 0b4b61168f9a51b821b88c3b8d35508066906d2b97774ba447e2b2c367604516 Aug 05 19:08:14.624365 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:14.624329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" event={"ID":"7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7","Type":"ContainerStarted","Data":"dc984d26911cb5a708d86ea054cdb21bcb1309373d72a01f2dbd6de40974be30"} Aug 05 19:08:14.624577 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:14.624440 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" Aug 05 19:08:14.625898 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:14.625870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" event={"ID":"8da2f257-830a-4b03-a3db-3deb3cb48c2d","Type":"ContainerStarted","Data":"0b4b61168f9a51b821b88c3b8d35508066906d2b97774ba447e2b2c367604516"} Aug 05 19:08:14.646254 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:14.646196 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" podStartSLOduration=0.970555535 podStartE2EDuration="3.646178496s" totalImagesPullingTime="2.675622961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:14.64485014 +0000 UTC m=+420.664913189" watchObservedRunningTime="2026-08-05 19:08:14.646178496 +0000 UTC m=+420.666241617" Aug 05 19:08:15.901252 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:15.901213 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c2r2p"] Aug 05 19:08:15.905880 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:15.905855 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" Aug 05 19:08:15.909020 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:15.909001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xqjkk\"" Aug 05 19:08:15.926139 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:15.926108 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c2r2p"] Aug 05 19:08:15.961131 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:15.961097 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxvhj\" (UniqueName: \"kubernetes.io/projected/b3a517e6-44e3-455b-9fcb-62824e95b506-kube-api-access-dxvhj\") pod \"authorino-operator-68d88948d8-c2r2p\" (UID: \"b3a517e6-44e3-455b-9fcb-62824e95b506\") " pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" Aug 05 19:08:16.062486 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:16.062453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxvhj\" (UniqueName: \"kubernetes.io/projected/b3a517e6-44e3-455b-9fcb-62824e95b506-kube-api-access-dxvhj\") pod \"authorino-operator-68d88948d8-c2r2p\" (UID: \"b3a517e6-44e3-455b-9fcb-62824e95b506\") " pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" Aug 05 19:08:16.077387 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:16.077354 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxvhj\" (UniqueName: \"kubernetes.io/projected/b3a517e6-44e3-455b-9fcb-62824e95b506-kube-api-access-dxvhj\") pod \"authorino-operator-68d88948d8-c2r2p\" (UID: \"b3a517e6-44e3-455b-9fcb-62824e95b506\") " pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" Aug 05 19:08:16.216494 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:16.216381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" Aug 05 19:08:16.364099 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:16.364063 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c2r2p"] Aug 05 19:08:16.367990 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:08:16.367957 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a517e6_44e3_455b_9fcb_62824e95b506.slice/crio-b918d08b1fe75ccdd3bbdd8c1ec80bc56a3f18f9eee0eafefdaff5e0c86f16af WatchSource:0}: Error finding container b918d08b1fe75ccdd3bbdd8c1ec80bc56a3f18f9eee0eafefdaff5e0c86f16af: Status 404 returned error can't find the container with id b918d08b1fe75ccdd3bbdd8c1ec80bc56a3f18f9eee0eafefdaff5e0c86f16af Aug 05 19:08:16.637259 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:16.637215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" event={"ID":"b3a517e6-44e3-455b-9fcb-62824e95b506","Type":"ContainerStarted","Data":"b918d08b1fe75ccdd3bbdd8c1ec80bc56a3f18f9eee0eafefdaff5e0c86f16af"} Aug 05 19:08:17.647769 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:17.647717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" event={"ID":"8da2f257-830a-4b03-a3db-3deb3cb48c2d","Type":"ContainerStarted","Data":"ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7"} Aug 05 19:08:17.648203 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:17.647905 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:17.667403 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:17.667353 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" podStartSLOduration=1.921964862 podStartE2EDuration="4.667339276s" totalImagesPullingTime="2.745374414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:17.666656514 +0000 UTC m=+423.686719563" watchObservedRunningTime="2026-08-05 19:08:17.667339276 +0000 UTC m=+423.687402324" Aug 05 19:08:19.659701 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:19.659663 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" event={"ID":"b3a517e6-44e3-455b-9fcb-62824e95b506","Type":"ContainerStarted","Data":"1df2e88bb4f4a4ce09a1d7af22f6aa8d3a03959aa4317d2b1f0ee87cdfbe9741"} Aug 05 19:08:19.660094 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:19.659741 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" Aug 05 19:08:19.678035 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:19.677984 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" podStartSLOduration=2.315374443 podStartE2EDuration="4.677965109s" totalImagesPullingTime="2.362590666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:19.676031078 +0000 UTC m=+425.696094129" watchObservedRunningTime="2026-08-05 19:08:19.677965109 +0000 UTC m=+425.698028156" Aug 05 19:08:25.632922 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:25.632889 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f5z4m" Aug 05 19:08:28.588904 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.588853 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs"] Aug 05 19:08:28.593017 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.592989 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:28.595404 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.595373 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Aug 05 19:08:28.595404 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.595400 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nfhfh\"" Aug 05 19:08:28.595971 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.595893 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Aug 05 19:08:28.607555 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.607523 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs"] Aug 05 19:08:28.656219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.656179 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:28.683677 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.683644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/000beaea-4921-44f3-af85-d37df3c58177-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:28.683883 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.683830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/000beaea-4921-44f3-af85-d37df3c58177-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:28.683883 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.683872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ftg2\" (UniqueName: \"kubernetes.io/projected/000beaea-4921-44f3-af85-d37df3c58177-kube-api-access-7ftg2\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:28.785236 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.785200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/000beaea-4921-44f3-af85-d37df3c58177-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:28.785425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.785287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/000beaea-4921-44f3-af85-d37df3c58177-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:28.785425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.785309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ftg2\" (UniqueName: \"kubernetes.io/projected/000beaea-4921-44f3-af85-d37df3c58177-kube-api-access-7ftg2\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:28.785527 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:08:28.785431 2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Aug 05 19:08:28.785527 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:08:28.785505 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/000beaea-4921-44f3-af85-d37df3c58177-plugin-serving-cert podName:000beaea-4921-44f3-af85-d37df3c58177 nodeName:}" failed. No retries permitted until 2026-08-05 19:08:29.285483973 +0000 UTC m=+435.305547014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/000beaea-4921-44f3-af85-d37df3c58177-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-q56vs" (UID: "000beaea-4921-44f3-af85-d37df3c58177") : secret "plugin-serving-cert" not found Aug 05 19:08:28.785984 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.785961 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/000beaea-4921-44f3-af85-d37df3c58177-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:28.794528 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:28.794490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ftg2\" (UniqueName: \"kubernetes.io/projected/000beaea-4921-44f3-af85-d37df3c58177-kube-api-access-7ftg2\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:29.290656 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:29.290612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/000beaea-4921-44f3-af85-d37df3c58177-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:29.293110 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:29.293074 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/000beaea-4921-44f3-af85-d37df3c58177-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-q56vs\" (UID: \"000beaea-4921-44f3-af85-d37df3c58177\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:29.512538 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:29.512502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" Aug 05 19:08:29.654211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:29.654178 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs"] Aug 05 19:08:29.656601 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:08:29.656562 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod000beaea_4921_44f3_af85_d37df3c58177.slice/crio-c0164286a999ff54f5f1bce8df8da81ff331051374f67b8cccf3c4098f014466 WatchSource:0}: Error finding container c0164286a999ff54f5f1bce8df8da81ff331051374f67b8cccf3c4098f014466: Status 404 returned error can't find the container with id c0164286a999ff54f5f1bce8df8da81ff331051374f67b8cccf3c4098f014466 Aug 05 19:08:29.708664 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:29.708628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" event={"ID":"000beaea-4921-44f3-af85-d37df3c58177","Type":"ContainerStarted","Data":"c0164286a999ff54f5f1bce8df8da81ff331051374f67b8cccf3c4098f014466"} Aug 05 19:08:30.666642 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:30.666612 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-c2r2p" Aug 05 19:08:34.744290 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:34.744195 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" event={"ID":"000beaea-4921-44f3-af85-d37df3c58177","Type":"ContainerStarted","Data":"f5175181d2fe0c84416983effe49b278a0d8b846e4082983fd4a6b017e961b87"} Aug 05 19:08:34.761202 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:34.761152 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-q56vs" podStartSLOduration=1.94632702 podStartE2EDuration="6.761134426s" totalImagesPullingTime="4.814807406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:34.759226807 +0000 UTC m=+440.779289854" watchObservedRunningTime="2026-08-05 19:08:34.761134426 +0000 UTC m=+440.781197474" Aug 05 19:08:38.787787 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.787687 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6"] Aug 05 19:08:38.788293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.787953 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" containerName="manager" containerID="cri-o://ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7" gracePeriod=2 Aug 05 19:08:38.801652 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.801616 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6"] Aug 05 19:08:38.813439 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:08:38.813396 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8da2f257-830a-4b03-a3db-3deb3cb48c2d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-h7hs6\": pods \"limitador-operator-controller-manager-6c549b6d85-h7hs6\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:38.814087 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.814060 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg"] Aug 05 19:08:38.814489 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.814472 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" containerName="manager" Aug 05 19:08:38.814575 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.814492 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" containerName="manager" Aug 05 19:08:38.814629 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.814606 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" containerName="manager" Aug 05 19:08:38.817674 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.817648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" Aug 05 19:08:38.845733 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.845698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg"] Aug 05 19:08:38.889490 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:08:38.889443 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-h7hs6\" is forbidden: User \"system:node:ip-10-0-131-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-134.ec2.internal' and this object" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:38.981351 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:38.981314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vj47\" (UniqueName: \"kubernetes.io/projected/e259fc6f-2c89-4098-b199-66474dc4e5a0-kube-api-access-4vj47\") pod \"limitador-operator-controller-manager-6c549b6d85-4cftg\" (UID: \"e259fc6f-2c89-4098-b199-66474dc4e5a0\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" Aug 05 19:08:39.046408 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.046339 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:39.048812 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:08:39.048779 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-h7hs6\" is forbidden: User \"system:node:ip-10-0-131-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-134.ec2.internal' and this object" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:39.082306 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.082265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vj47\" (UniqueName: \"kubernetes.io/projected/e259fc6f-2c89-4098-b199-66474dc4e5a0-kube-api-access-4vj47\") pod \"limitador-operator-controller-manager-6c549b6d85-4cftg\" (UID: \"e259fc6f-2c89-4098-b199-66474dc4e5a0\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" Aug 05 19:08:39.093731 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.093699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vj47\" (UniqueName: \"kubernetes.io/projected/e259fc6f-2c89-4098-b199-66474dc4e5a0-kube-api-access-4vj47\") pod \"limitador-operator-controller-manager-6c549b6d85-4cftg\" (UID: \"e259fc6f-2c89-4098-b199-66474dc4e5a0\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" Aug 05 19:08:39.181224 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.181190 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" Aug 05 19:08:39.183509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.183474 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wplm\" (UniqueName: \"kubernetes.io/projected/8da2f257-830a-4b03-a3db-3deb3cb48c2d-kube-api-access-7wplm\") pod \"8da2f257-830a-4b03-a3db-3deb3cb48c2d\" (UID: \"8da2f257-830a-4b03-a3db-3deb3cb48c2d\") " Aug 05 19:08:39.185782 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.185723 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8da2f257-830a-4b03-a3db-3deb3cb48c2d-kube-api-access-7wplm" (OuterVolumeSpecName: "kube-api-access-7wplm") pod "8da2f257-830a-4b03-a3db-3deb3cb48c2d" (UID: "8da2f257-830a-4b03-a3db-3deb3cb48c2d"). InnerVolumeSpecName "kube-api-access-7wplm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:08:39.284788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.284741 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wplm\" (UniqueName: \"kubernetes.io/projected/8da2f257-830a-4b03-a3db-3deb3cb48c2d-kube-api-access-7wplm\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:08:39.325660 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.323469 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg"] Aug 05 19:08:39.328763 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:08:39.328720 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode259fc6f_2c89_4098_b199_66474dc4e5a0.slice/crio-2dc8a5f5d145dcc9b058238aa6c811921d5ed89633f133a9dded1b0c4eba44f4 WatchSource:0}: Error finding container 2dc8a5f5d145dcc9b058238aa6c811921d5ed89633f133a9dded1b0c4eba44f4: Status 404 returned error can't find the container with id 2dc8a5f5d145dcc9b058238aa6c811921d5ed89633f133a9dded1b0c4eba44f4 Aug 05 19:08:39.770325 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.770228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" event={"ID":"e259fc6f-2c89-4098-b199-66474dc4e5a0","Type":"ContainerStarted","Data":"fc954744c23a6ebee54dffcb7acd2fe11a2850795bca47d7a2f0aa8a489ebcc2"} Aug 05 19:08:39.770325 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.770297 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" event={"ID":"e259fc6f-2c89-4098-b199-66474dc4e5a0","Type":"ContainerStarted","Data":"2dc8a5f5d145dcc9b058238aa6c811921d5ed89633f133a9dded1b0c4eba44f4"} Aug 05 19:08:39.770547 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.770368 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" Aug 05 19:08:39.771608 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.771582 2578 generic.go:356] "Generic (PLEG): container finished" podID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" containerID="ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7" exitCode=0 Aug 05 19:08:39.771688 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.771632 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:39.771688 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.771682 2578 scope.go:117] "RemoveContainer" containerID="ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7" Aug 05 19:08:39.772676 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:08:39.772540 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-h7hs6\" is forbidden: User \"system:node:ip-10-0-131-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-134.ec2.internal' and this object" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:39.780529 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.780511 2578 scope.go:117] "RemoveContainer" containerID="ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7" Aug 05 19:08:39.780867 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:08:39.780847 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7\": container with ID starting with ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7 not found: ID does not exist" containerID="ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7" Aug 05 19:08:39.780926 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.780876 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7"} err="failed to get container status \"ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7\": rpc error: code = NotFound desc = could not find container \"ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7\": container with ID starting with ff485916c86a70f0bf87c34b87966e40e47fe5dbf9d3731bcad8ccf1a11dbfe7 not found: ID does not exist" Aug 05 19:08:39.791813 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:39.791726 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" podStartSLOduration=1.7917108640000001 podStartE2EDuration="1.791710864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:08:39.791184893 +0000 UTC m=+445.811247941" watchObservedRunningTime="2026-08-05 19:08:39.791710864 +0000 UTC m=+445.811773912" Aug 05 19:08:39.793183 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:08:39.793153 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-h7hs6\" is forbidden: User \"system:node:ip-10-0-131-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-134.ec2.internal' and this object" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h7hs6" Aug 05 19:08:40.539999 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:40.539960 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8da2f257-830a-4b03-a3db-3deb3cb48c2d" path="/var/lib/kubelet/pods/8da2f257-830a-4b03-a3db-3deb3cb48c2d/volumes" Aug 05 19:08:50.780320 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:08:50.780286 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4cftg" Aug 05 19:09:11.181588 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.181547 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h"] Aug 05 19:09:11.185182 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.185156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.187809 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.187783 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2mgk8\"" Aug 05 19:09:11.197743 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.197710 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h"] Aug 05 19:09:11.256080 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.256080 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.256353 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.256353 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/200a5a92-ba21-4a0f-a251-7aec0d369937-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.256353 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.256353 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.256353 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.256353 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmvh\" (UniqueName: \"kubernetes.io/projected/200a5a92-ba21-4a0f-a251-7aec0d369937-kube-api-access-njmvh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.256663 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.256389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357171 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/200a5a92-ba21-4a0f-a251-7aec0d369937-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357171 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357394 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357394 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357494 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njmvh\" (UniqueName: \"kubernetes.io/projected/200a5a92-ba21-4a0f-a251-7aec0d369937-kube-api-access-njmvh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357562 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357578 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357731 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357647 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357731 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357868 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.357935 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.357861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.358024 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.358001 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.358202 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.358184 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/200a5a92-ba21-4a0f-a251-7aec0d369937-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.359660 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.359630 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.360151 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.360133 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.365892 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.365862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/200a5a92-ba21-4a0f-a251-7aec0d369937-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.366047 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.366026 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmvh\" (UniqueName: \"kubernetes.io/projected/200a5a92-ba21-4a0f-a251-7aec0d369937-kube-api-access-njmvh\") pod \"maas-default-gateway-openshift-default-5ccb968c66-l4g8h\" (UID: \"200a5a92-ba21-4a0f-a251-7aec0d369937\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.498670 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.498579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:11.645493 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.645464 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h"] Aug 05 19:09:11.647563 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:09:11.647535 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200a5a92_ba21_4a0f_a251_7aec0d369937.slice/crio-92e1f3a9405f77b817742173d7c11c42da33b8998c7c1cca27af027165155985 WatchSource:0}: Error finding container 92e1f3a9405f77b817742173d7c11c42da33b8998c7c1cca27af027165155985: Status 404 returned error can't find the container with id 92e1f3a9405f77b817742173d7c11c42da33b8998c7c1cca27af027165155985 Aug 05 19:09:11.649630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.649595 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:09:11.649729 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.649705 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:09:11.649859 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.649836 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:09:11.929316 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.929242 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" event={"ID":"200a5a92-ba21-4a0f-a251-7aec0d369937","Type":"ContainerStarted","Data":"b41d09f6b70d8e809d53679e925f9fe143c732748cf59c3a9d92726b61b802d2"} Aug 05 19:09:11.929493 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.929338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" event={"ID":"200a5a92-ba21-4a0f-a251-7aec0d369937","Type":"ContainerStarted","Data":"92e1f3a9405f77b817742173d7c11c42da33b8998c7c1cca27af027165155985"} Aug 05 19:09:11.949281 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:11.949221 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" podStartSLOduration=0.949200671 podStartE2EDuration="949.200671ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:09:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:09:11.947334507 +0000 UTC m=+477.967397555" watchObservedRunningTime="2026-08-05 19:09:11.949200671 +0000 UTC m=+477.969263791" Aug 05 19:09:12.498935 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:12.498893 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:12.504739 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:12.504707 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:12.934513 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:12.934476 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:09:12.935631 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:09:12.935605 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:10:40.641546 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.641505 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w"] Aug 05 19:10:40.645018 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.645000 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:40.647580 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.647542 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Aug 05 19:10:40.653393 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.653365 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w"] Aug 05 19:10:40.663113 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.663078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcfnp\" (UniqueName: \"kubernetes.io/projected/589435c3-d533-4ce1-b2da-d6e9c2646d08-kube-api-access-zcfnp\") pod \"payload-pre-processing-687dbb6cf6-zsg8w\" (UID: \"589435c3-d533-4ce1-b2da-d6e9c2646d08\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:40.663266 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.663123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/589435c3-d533-4ce1-b2da-d6e9c2646d08-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zsg8w\" (UID: \"589435c3-d533-4ce1-b2da-d6e9c2646d08\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:40.690077 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.690040 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8gfg5"] Aug 05 19:10:40.693717 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.693693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:40.695979 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.695957 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2dzfh\"" Aug 05 19:10:40.701533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.701457 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8gfg5"] Aug 05 19:10:40.764212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.764171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8gfg5\" (UID: \"c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:40.764212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.764215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcfnp\" (UniqueName: \"kubernetes.io/projected/589435c3-d533-4ce1-b2da-d6e9c2646d08-kube-api-access-zcfnp\") pod \"payload-pre-processing-687dbb6cf6-zsg8w\" (UID: \"589435c3-d533-4ce1-b2da-d6e9c2646d08\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:40.764457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.764257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/589435c3-d533-4ce1-b2da-d6e9c2646d08-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zsg8w\" (UID: \"589435c3-d533-4ce1-b2da-d6e9c2646d08\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:40.764457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.764282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhfsz\" (UniqueName: \"kubernetes.io/projected/c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9-kube-api-access-lhfsz\") pod \"payload-processing-5cc6cd444b-8gfg5\" (UID: \"c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:40.765058 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.765031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/589435c3-d533-4ce1-b2da-d6e9c2646d08-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zsg8w\" (UID: \"589435c3-d533-4ce1-b2da-d6e9c2646d08\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:40.777639 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.777609 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcfnp\" (UniqueName: \"kubernetes.io/projected/589435c3-d533-4ce1-b2da-d6e9c2646d08-kube-api-access-zcfnp\") pod \"payload-pre-processing-687dbb6cf6-zsg8w\" (UID: \"589435c3-d533-4ce1-b2da-d6e9c2646d08\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:40.864831 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.864791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhfsz\" (UniqueName: \"kubernetes.io/projected/c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9-kube-api-access-lhfsz\") pod \"payload-processing-5cc6cd444b-8gfg5\" (UID: \"c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:40.865029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.864919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8gfg5\" (UID: \"c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:40.865768 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.865729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8gfg5\" (UID: \"c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:40.876095 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.876061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhfsz\" (UniqueName: \"kubernetes.io/projected/c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9-kube-api-access-lhfsz\") pod \"payload-processing-5cc6cd444b-8gfg5\" (UID: \"c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:40.957160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:40.957067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:41.005402 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:41.005367 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:41.110587 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:41.110556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w"] Aug 05 19:10:41.112550 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:10:41.112522 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589435c3_d533_4ce1_b2da_d6e9c2646d08.slice/crio-be54274231e8475ac8438f654930f234f2d27c18bfcc7b40385d307310e89efd WatchSource:0}: Error finding container be54274231e8475ac8438f654930f234f2d27c18bfcc7b40385d307310e89efd: Status 404 returned error can't find the container with id be54274231e8475ac8438f654930f234f2d27c18bfcc7b40385d307310e89efd Aug 05 19:10:41.164893 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:41.164781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8gfg5"] Aug 05 19:10:41.167156 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:10:41.167124 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67e10b3_6593_4fb7_a6e8_2b5d37d9e4f9.slice/crio-8d8180c3dc8b8cfe4ba91c8ddd4fc34fe7e9aa1720a6c5430e8e743f71e1da03 WatchSource:0}: Error finding container 8d8180c3dc8b8cfe4ba91c8ddd4fc34fe7e9aa1720a6c5430e8e743f71e1da03: Status 404 returned error can't find the container with id 8d8180c3dc8b8cfe4ba91c8ddd4fc34fe7e9aa1720a6c5430e8e743f71e1da03 Aug 05 19:10:41.369212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:41.369173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" event={"ID":"c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9","Type":"ContainerStarted","Data":"8d8180c3dc8b8cfe4ba91c8ddd4fc34fe7e9aa1720a6c5430e8e743f71e1da03"} Aug 05 19:10:41.370391 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:41.370365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" event={"ID":"589435c3-d533-4ce1-b2da-d6e9c2646d08","Type":"ContainerStarted","Data":"be54274231e8475ac8438f654930f234f2d27c18bfcc7b40385d307310e89efd"} Aug 05 19:10:45.399538 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:45.399498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" event={"ID":"c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9","Type":"ContainerStarted","Data":"2fdab476313c527e5620ef7339cbed8bd7eb1db781c9251a0384d65ea9349844"} Aug 05 19:10:45.400050 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:45.399603 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:45.401223 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:45.401196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" event={"ID":"589435c3-d533-4ce1-b2da-d6e9c2646d08","Type":"ContainerStarted","Data":"8520ed75b86fcfe302285ef6e64031f0564c01b1ba07b17d6e77a44cf81793e8"} Aug 05 19:10:45.401328 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:45.401274 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:45.417199 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:45.417144 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" podStartSLOduration=2.070976277 podStartE2EDuration="5.417126721s" totalImagesPullingTime="3.346150444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:10:45.414684993 +0000 UTC m=+571.434748038" watchObservedRunningTime="2026-08-05 19:10:45.417126721 +0000 UTC m=+571.437189768" Aug 05 19:10:45.431196 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:45.431127 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" podStartSLOduration=2.037859684 podStartE2EDuration="5.431102028s" totalImagesPullingTime="3.393242344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:10:45.428732744 +0000 UTC m=+571.448795793" watchObservedRunningTime="2026-08-05 19:10:45.431102028 +0000 UTC m=+571.451165078" Aug 05 19:10:50.431321 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:50.431231 2578 generic.go:356] "Generic (PLEG): container finished" podID="200a5a92-ba21-4a0f-a251-7aec0d369937" containerID="b41d09f6b70d8e809d53679e925f9fe143c732748cf59c3a9d92726b61b802d2" exitCode=0 Aug 05 19:10:50.431321 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:50.431304 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" event={"ID":"200a5a92-ba21-4a0f-a251-7aec0d369937","Type":"ContainerDied","Data":"b41d09f6b70d8e809d53679e925f9fe143c732748cf59c3a9d92726b61b802d2"} Aug 05 19:10:50.432129 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:50.432114 2578 scope.go:117] "RemoveContainer" containerID="b41d09f6b70d8e809d53679e925f9fe143c732748cf59c3a9d92726b61b802d2" Aug 05 19:10:50.433109 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:50.433086 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:10:50.433176 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:50.433159 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:10:50.433211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:50.433191 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:10:51.443127 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:51.443082 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" event={"ID":"200a5a92-ba21-4a0f-a251-7aec0d369937","Type":"ContainerStarted","Data":"7e97998af81e1c0ec8a64d70773f328545582a634485248e296717d44f2b4b39"} Aug 05 19:10:51.499201 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:51.499166 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:10:51.499378 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:51.499322 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-l4g8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Aug 05 19:10:51.499424 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:51.499376 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" podUID="200a5a92-ba21-4a0f-a251-7aec0d369937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Aug 05 19:10:52.499172 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:52.499128 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-l4g8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Aug 05 19:10:52.499568 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:52.499187 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" podUID="200a5a92-ba21-4a0f-a251-7aec0d369937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Aug 05 19:10:53.499073 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:53.499038 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-l4g8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Aug 05 19:10:53.499258 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:53.499093 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" podUID="200a5a92-ba21-4a0f-a251-7aec0d369937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Aug 05 19:10:54.499645 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:54.499608 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-l4g8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Aug 05 19:10:54.500053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:54.499678 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" podUID="200a5a92-ba21-4a0f-a251-7aec0d369937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Aug 05 19:10:55.499335 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:55.499294 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-l4g8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Aug 05 19:10:55.499517 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:55.499362 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" podUID="200a5a92-ba21-4a0f-a251-7aec0d369937" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Aug 05 19:10:56.409004 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:56.408954 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zsg8w" Aug 05 19:10:56.409393 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:56.409066 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8gfg5" Aug 05 19:10:56.650169 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:56.650133 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:10:56.650726 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:56.650702 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:10:56.651560 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:10:56.651538 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-l4g8h" Aug 05 19:11:05.074148 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.074109 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl"] Aug 05 19:11:05.082794 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.082761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.087758 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.087706 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Aug 05 19:11:05.088555 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.088529 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Aug 05 19:11:05.088877 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.088850 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Aug 05 19:11:05.089030 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.088918 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8tm4f\"" Aug 05 19:11:05.090854 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.090514 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl"] Aug 05 19:11:05.194881 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.194846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.195067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.194889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.195067 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.195027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.195153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.195069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.195197 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.195170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkrcq\" (UniqueName: \"kubernetes.io/projected/b67e20ed-611f-4f24-97a6-478004bacf1c-kube-api-access-zkrcq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.195282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.195264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b67e20ed-611f-4f24-97a6-478004bacf1c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296024 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.295985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296024 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.296029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296283 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.296070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296283 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.296089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296283 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.296125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkrcq\" (UniqueName: \"kubernetes.io/projected/b67e20ed-611f-4f24-97a6-478004bacf1c-kube-api-access-zkrcq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296283 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.296175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b67e20ed-611f-4f24-97a6-478004bacf1c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296546 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.296520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296608 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.296553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.296608 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.296597 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.298340 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.298319 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b67e20ed-611f-4f24-97a6-478004bacf1c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.298601 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.298583 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b67e20ed-611f-4f24-97a6-478004bacf1c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.304211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.304181 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkrcq\" (UniqueName: \"kubernetes.io/projected/b67e20ed-611f-4f24-97a6-478004bacf1c-kube-api-access-zkrcq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gghfl\" (UID: \"b67e20ed-611f-4f24-97a6-478004bacf1c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.394533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.394426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:05.540358 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:05.540326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl"] Aug 05 19:11:05.541880 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:11:05.541849 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67e20ed_611f_4f24_97a6_478004bacf1c.slice/crio-768b82492dbb99fe058285280cac1ea277c3f781c6831eb334a485b9e93653e1 WatchSource:0}: Error finding container 768b82492dbb99fe058285280cac1ea277c3f781c6831eb334a485b9e93653e1: Status 404 returned error can't find the container with id 768b82492dbb99fe058285280cac1ea277c3f781c6831eb334a485b9e93653e1 Aug 05 19:11:06.525550 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:06.525440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" event={"ID":"b67e20ed-611f-4f24-97a6-478004bacf1c","Type":"ContainerStarted","Data":"768b82492dbb99fe058285280cac1ea277c3f781c6831eb334a485b9e93653e1"} Aug 05 19:11:07.532538 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:07.532497 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" event={"ID":"b67e20ed-611f-4f24-97a6-478004bacf1c","Type":"ContainerStarted","Data":"286c2ddf7e6a5bea57709859cb7f1306487a300e116dbe104bdc4b728664343c"} Aug 05 19:11:07.548227 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:07.548164 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" podStartSLOduration=1.433020743 podStartE2EDuration="2.548145832s" totalImagesPullingTime="1.115125089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:11:07.548107351 +0000 UTC m=+593.568170422" watchObservedRunningTime="2026-08-05 19:11:07.548145832 +0000 UTC m=+593.568209004" Aug 05 19:11:14.441206 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:14.441179 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:11:14.441811 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:14.441240 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:11:15.394883 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:15.394838 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:15.395073 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:15.394921 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:15.407780 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:15.407734 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:11:15.590026 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:11:15.589990 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gghfl" Aug 05 19:12:11.679153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.679108 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh"] Aug 05 19:12:11.682718 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.682699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.685282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.685250 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Aug 05 19:12:11.687469 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.687450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.687573 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.687503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c036955e-d811-46df-aa73-8560108eb290-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.687573 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.687531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.687573 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.687550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.687573 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.687569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.687709 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.687611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsdhk\" (UniqueName: \"kubernetes.io/projected/c036955e-d811-46df-aa73-8560108eb290-kube-api-access-dsdhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.692403 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.692377 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh"] Aug 05 19:12:11.788719 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.788674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.788936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.788774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c036955e-d811-46df-aa73-8560108eb290-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.788936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.788813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.788936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.788838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.788936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.788858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.788936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.788895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsdhk\" (UniqueName: \"kubernetes.io/projected/c036955e-d811-46df-aa73-8560108eb290-kube-api-access-dsdhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.789193 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.789163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.789244 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.789213 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.789310 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.789291 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.791215 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.791191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c036955e-d811-46df-aa73-8560108eb290-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.791306 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.791286 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c036955e-d811-46df-aa73-8560108eb290-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.796436 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.796414 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsdhk\" (UniqueName: \"kubernetes.io/projected/c036955e-d811-46df-aa73-8560108eb290-kube-api-access-dsdhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfmrh\" (UID: \"c036955e-d811-46df-aa73-8560108eb290\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:11.995176 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:11.995083 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:12.138052 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:12.138021 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh"] Aug 05 19:12:12.139939 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:12:12.139906 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc036955e_d811_46df_aa73_8560108eb290.slice/crio-b421d372ed3182a994712dea9ed39a24112fa21a4039d7d156d966cc09ec12f3 WatchSource:0}: Error finding container b421d372ed3182a994712dea9ed39a24112fa21a4039d7d156d966cc09ec12f3: Status 404 returned error can't find the container with id b421d372ed3182a994712dea9ed39a24112fa21a4039d7d156d966cc09ec12f3 Aug 05 19:12:12.141344 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:12.141322 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 19:12:12.854138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:12.854100 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" event={"ID":"c036955e-d811-46df-aa73-8560108eb290","Type":"ContainerStarted","Data":"c3159dc4265710034fbd720132d752511ddf089d80e215a337f65eafbe49c655"} Aug 05 19:12:12.854534 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:12.854159 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" event={"ID":"c036955e-d811-46df-aa73-8560108eb290","Type":"ContainerStarted","Data":"b421d372ed3182a994712dea9ed39a24112fa21a4039d7d156d966cc09ec12f3"} Aug 05 19:12:12.871765 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:12.871686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" podStartSLOduration=1.670263845 podStartE2EDuration="1.871668024s" totalImagesPullingTime="201.404179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:12:12.869884414 +0000 UTC m=+658.889947475" watchObservedRunningTime="2026-08-05 19:12:12.871668024 +0000 UTC m=+658.891731072" Aug 05 19:12:21.995700 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:21.995654 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:21.996263 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:21.995740 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:22.009098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:22.009070 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:12:22.921665 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:12:22.921628 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfmrh" Aug 05 19:16:14.471933 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:16:14.471901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:16:14.473678 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:16:14.473654 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:21:14.501802 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:21:14.501774 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:21:14.504311 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:21:14.504254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:26:14.554596 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:26:14.554558 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:26:14.556977 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:26:14.556017 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:31:11.969848 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:11.969703 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs"] Aug 05 19:31:11.973564 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:11.973540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:11.976981 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:11.976953 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-aaec4fc4-openshift-default-dockercfg-2tg2h\"" Aug 05 19:31:11.995322 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:11.995281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs"] Aug 05 19:31:12.029620 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.029577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-credential-socket\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.029808 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.029629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-podinfo\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.029808 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.029706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-certs\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.029891 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.029842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-token\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.029932 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.029889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-data\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.029932 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.029917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-envoy\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.029995 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.029978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v857\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-kube-api-access-7v857\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.030029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.030009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-socket\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.030062 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.030050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istiod-ca-cert\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131346 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v857\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-kube-api-access-7v857\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131531 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-socket\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131531 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istiod-ca-cert\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131531 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-credential-socket\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131531 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-podinfo\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131531 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-certs\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131833 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131565 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-token\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131833 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-data\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131833 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-envoy\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.131994 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.131910 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-socket\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.132084 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.132058 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-credential-socket\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.132219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.132196 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-certs\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.132341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.132315 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istiod-ca-cert\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.132388 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.132373 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-data\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.134046 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.134024 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-envoy\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.134233 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.134212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-podinfo\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.141207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.141178 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v857\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-kube-api-access-7v857\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.142831 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.142809 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-token\") pod \"e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.284506 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.284405 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:12.442818 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.442789 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs"] Aug 05 19:31:12.444357 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:31:12.444330 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bdd13b_c363_4bed_b651_a0f6853d7ed4.slice/crio-7e2799a557186586969d0fcda5ac05f78eaeb518461dc6b90888884df8291f2e WatchSource:0}: Error finding container 7e2799a557186586969d0fcda5ac05f78eaeb518461dc6b90888884df8291f2e: Status 404 returned error can't find the container with id 7e2799a557186586969d0fcda5ac05f78eaeb518461dc6b90888884df8291f2e Aug 05 19:31:12.446879 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.446839 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:12.446969 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.446954 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:12.447017 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.447000 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:12.775810 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.775736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" event={"ID":"b9bdd13b-c363-4bed-b651-a0f6853d7ed4","Type":"ContainerStarted","Data":"067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba"} Aug 05 19:31:12.776029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:12.775839 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" event={"ID":"b9bdd13b-c363-4bed-b651-a0f6853d7ed4","Type":"ContainerStarted","Data":"7e2799a557186586969d0fcda5ac05f78eaeb518461dc6b90888884df8291f2e"} Aug 05 19:31:13.284837 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:13.284790 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:13.290355 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:13.290325 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:13.321574 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:13.321516 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podStartSLOduration=2.321497404 podStartE2EDuration="2.321497404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:31:12.815567066 +0000 UTC m=+1798.835630113" watchObservedRunningTime="2026-08-05 19:31:13.321497404 +0000 UTC m=+1799.341560452" Aug 05 19:31:13.781236 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:13.781199 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:13.782231 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:13.782208 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:14.590133 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:14.590019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:31:14.605090 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:14.593376 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:31:16.329275 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.329232 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2"] Aug 05 19:31:16.332828 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.332739 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:16.336112 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.336088 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-aaec4fc4\"" Aug 05 19:31:16.336253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.336091 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-aaec4fc4-dockercfg-xwbk5\"" Aug 05 19:31:16.343077 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.343047 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2"] Aug 05 19:31:16.373621 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.373584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2\" (UID: \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:16.373812 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.373721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84vxk\" (UniqueName: \"kubernetes.io/projected/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-kube-api-access-84vxk\") pod \"payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2\" (UID: \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:16.422835 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.422799 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4"] Aug 05 19:31:16.426978 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.426957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:16.445257 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.445220 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4"] Aug 05 19:31:16.475237 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.475193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2\" (UID: \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:16.475447 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.475270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbsnm\" (UniqueName: \"kubernetes.io/projected/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-kube-api-access-xbsnm\") pod \"payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4\" (UID: \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\") " pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:16.475447 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.475361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-plugins-config-volume\") pod \"payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4\" (UID: \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\") " pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:16.475447 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.475394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84vxk\" (UniqueName: \"kubernetes.io/projected/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-kube-api-access-84vxk\") pod \"payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2\" (UID: \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:16.476018 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.475996 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2\" (UID: \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:16.490642 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.490610 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84vxk\" (UniqueName: \"kubernetes.io/projected/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-kube-api-access-84vxk\") pod \"payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2\" (UID: \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:16.576687 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.576649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-plugins-config-volume\") pod \"payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4\" (UID: \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\") " pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:16.576918 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.576731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbsnm\" (UniqueName: \"kubernetes.io/projected/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-kube-api-access-xbsnm\") pod \"payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4\" (UID: \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\") " pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:16.577490 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.577469 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-plugins-config-volume\") pod \"payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4\" (UID: \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\") " pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:16.586489 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.586421 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbsnm\" (UniqueName: \"kubernetes.io/projected/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-kube-api-access-xbsnm\") pod \"payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4\" (UID: \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\") " pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:16.644163 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.644118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:16.738373 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.738106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:16.799729 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:16.799704 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2"] Aug 05 19:31:16.802598 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:31:16.802565 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a16e6b_d9b2_4ebc_8f8b_5ae084c6f956.slice/crio-4c45554d93a87514255e7015bdc7a82ecc61a00f6b355e93dae9c244fb7f4f6e WatchSource:0}: Error finding container 4c45554d93a87514255e7015bdc7a82ecc61a00f6b355e93dae9c244fb7f4f6e: Status 404 returned error can't find the container with id 4c45554d93a87514255e7015bdc7a82ecc61a00f6b355e93dae9c244fb7f4f6e Aug 05 19:31:17.110350 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.110324 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4"] Aug 05 19:31:17.112505 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:31:17.112469 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1d301c_c0af_4acd_bbb7_cdffb9b94a53.slice/crio-e4422c9ce5ac5bccd2167d1d7cac6d7c3b525945466d459e9847f40fa9e5504a WatchSource:0}: Error finding container e4422c9ce5ac5bccd2167d1d7cac6d7c3b525945466d459e9847f40fa9e5504a: Status 404 returned error can't find the container with id e4422c9ce5ac5bccd2167d1d7cac6d7c3b525945466d459e9847f40fa9e5504a Aug 05 19:31:17.804174 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.804135 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" event={"ID":"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956","Type":"ContainerStarted","Data":"78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b"} Aug 05 19:31:17.804668 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.804413 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" event={"ID":"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956","Type":"ContainerStarted","Data":"4c45554d93a87514255e7015bdc7a82ecc61a00f6b355e93dae9c244fb7f4f6e"} Aug 05 19:31:17.804668 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.804459 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:17.805679 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.805654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" event={"ID":"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53","Type":"ContainerStarted","Data":"bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c"} Aug 05 19:31:17.805803 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.805705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" event={"ID":"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53","Type":"ContainerStarted","Data":"e4422c9ce5ac5bccd2167d1d7cac6d7c3b525945466d459e9847f40fa9e5504a"} Aug 05 19:31:17.805803 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.805779 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:17.823319 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.823265 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" podStartSLOduration=1.823248409 podStartE2EDuration="1.823248409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:31:17.821915678 +0000 UTC m=+1803.841978727" watchObservedRunningTime="2026-08-05 19:31:17.823248409 +0000 UTC m=+1803.843311457" Aug 05 19:31:17.842630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:17.842569 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" podStartSLOduration=1.842552234 podStartE2EDuration="1.842552234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:31:17.840047976 +0000 UTC m=+1803.860111022" watchObservedRunningTime="2026-08-05 19:31:17.842552234 +0000 UTC m=+1803.862615281" Aug 05 19:31:28.782549 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.782503 2578 patch_prober.go:28] interesting pod/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Aug 05 19:31:28.783011 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.782568 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Aug 05 19:31:28.814234 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.814205 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:28.814384 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.814274 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:28.876185 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.876097 2578 generic.go:356] "Generic (PLEG): container finished" podID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerID="067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba" exitCode=0 Aug 05 19:31:28.876474 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.876219 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" event={"ID":"b9bdd13b-c363-4bed-b651-a0f6853d7ed4","Type":"ContainerDied","Data":"067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba"} Aug 05 19:31:28.876949 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.876923 2578 scope.go:117] "RemoveContainer" containerID="067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba" Aug 05 19:31:28.878668 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.878624 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:28.878852 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.878824 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:28.878949 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:28.878901 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:29.883261 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:29.883223 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" event={"ID":"b9bdd13b-c363-4bed-b651-a0f6853d7ed4","Type":"ContainerStarted","Data":"b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92"} Aug 05 19:31:30.285683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:30.285578 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:30.286005 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:30.285977 2578 patch_prober.go:28] interesting pod/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Aug 05 19:31:30.286093 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:30.286040 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Aug 05 19:31:31.285658 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:31.285617 2578 patch_prober.go:28] interesting pod/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Aug 05 19:31:31.286105 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:31.285678 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Aug 05 19:31:32.285214 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:32.285180 2578 patch_prober.go:28] interesting pod/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Aug 05 19:31:32.285397 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:32.285240 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Aug 05 19:31:33.285621 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:33.285576 2578 patch_prober.go:28] interesting pod/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Aug 05 19:31:33.286053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:33.285633 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Aug 05 19:31:34.285373 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:34.285331 2578 patch_prober.go:28] interesting pod/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Aug 05 19:31:34.285552 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:34.285392 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Aug 05 19:31:35.289870 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:35.289834 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:35.290297 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:35.290073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:35.290855 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:35.290831 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:46.045140 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.045100 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4"] Aug 05 19:31:46.045731 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.045461 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" podUID="7e1d301c-c0af-4acd-bbb7-cdffb9b94a53" containerName="payload-processing" containerID="cri-o://bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c" gracePeriod=30 Aug 05 19:31:46.054201 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.053563 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2"] Aug 05 19:31:46.054201 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.053872 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" podUID="f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956" containerName="payload-pre-processing" containerID="cri-o://78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b" gracePeriod=30 Aug 05 19:31:46.344195 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.344162 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs"] Aug 05 19:31:46.344707 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.344379 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" containerID="cri-o://b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92" gracePeriod=30 Aug 05 19:31:46.364841 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.364801 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:46.370893 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.370861 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:46.376849 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.376814 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-plugins-config-volume\") pod \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\" (UID: \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\") " Aug 05 19:31:46.377035 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.377013 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84vxk\" (UniqueName: \"kubernetes.io/projected/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-kube-api-access-84vxk\") pod \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\" (UID: \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\") " Aug 05 19:31:46.377104 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.377043 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbsnm\" (UniqueName: \"kubernetes.io/projected/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-kube-api-access-xbsnm\") pod \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\" (UID: \"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53\") " Aug 05 19:31:46.377187 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.377165 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-plugins-config-volume\") pod \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\" (UID: \"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956\") " Aug 05 19:31:46.377586 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.377253 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7e1d301c-c0af-4acd-bbb7-cdffb9b94a53" (UID: "7e1d301c-c0af-4acd-bbb7-cdffb9b94a53"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:31:46.377707 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.377617 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956" (UID: "f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:31:46.377707 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.377624 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:46.379462 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.379435 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-kube-api-access-xbsnm" (OuterVolumeSpecName: "kube-api-access-xbsnm") pod "7e1d301c-c0af-4acd-bbb7-cdffb9b94a53" (UID: "7e1d301c-c0af-4acd-bbb7-cdffb9b94a53"). InnerVolumeSpecName "kube-api-access-xbsnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:31:46.379726 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.379707 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-kube-api-access-84vxk" (OuterVolumeSpecName: "kube-api-access-84vxk") pod "f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956" (UID: "f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956"). InnerVolumeSpecName "kube-api-access-84vxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:31:46.479168 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.479122 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:46.479168 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.479161 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84vxk\" (UniqueName: \"kubernetes.io/projected/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956-kube-api-access-84vxk\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:46.479168 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.479171 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbsnm\" (UniqueName: \"kubernetes.io/projected/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53-kube-api-access-xbsnm\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:46.974538 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.974498 2578 generic.go:356] "Generic (PLEG): container finished" podID="7e1d301c-c0af-4acd-bbb7-cdffb9b94a53" containerID="bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c" exitCode=0 Aug 05 19:31:46.974733 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.974564 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" Aug 05 19:31:46.974733 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.974584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" event={"ID":"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53","Type":"ContainerDied","Data":"bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c"} Aug 05 19:31:46.974733 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.974635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4" event={"ID":"7e1d301c-c0af-4acd-bbb7-cdffb9b94a53","Type":"ContainerDied","Data":"e4422c9ce5ac5bccd2167d1d7cac6d7c3b525945466d459e9847f40fa9e5504a"} Aug 05 19:31:46.974733 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.974659 2578 scope.go:117] "RemoveContainer" containerID="bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c" Aug 05 19:31:46.976027 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.976000 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956" containerID="78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b" exitCode=0 Aug 05 19:31:46.976143 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.976032 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" event={"ID":"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956","Type":"ContainerDied","Data":"78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b"} Aug 05 19:31:46.976143 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.976072 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" Aug 05 19:31:46.976143 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.976102 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2" event={"ID":"f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956","Type":"ContainerDied","Data":"4c45554d93a87514255e7015bdc7a82ecc61a00f6b355e93dae9c244fb7f4f6e"} Aug 05 19:31:46.984486 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.984465 2578 scope.go:117] "RemoveContainer" containerID="bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c" Aug 05 19:31:46.984800 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:31:46.984780 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c\": container with ID starting with bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c not found: ID does not exist" containerID="bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c" Aug 05 19:31:46.984855 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.984810 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c"} err="failed to get container status \"bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c\": rpc error: code = NotFound desc = could not find container \"bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c\": container with ID starting with bd05bf5fda925844bbc4cd098e80cfeb2592f4b1a8abba00012fc1b1d049e07c not found: ID does not exist" Aug 05 19:31:46.984855 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.984828 2578 scope.go:117] "RemoveContainer" containerID="78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b" Aug 05 19:31:46.993298 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.993277 2578 scope.go:117] "RemoveContainer" containerID="78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b" Aug 05 19:31:46.993595 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:31:46.993576 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b\": container with ID starting with 78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b not found: ID does not exist" containerID="78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b" Aug 05 19:31:46.993663 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:46.993604 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b"} err="failed to get container status \"78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b\": rpc error: code = NotFound desc = could not find container \"78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b\": container with ID starting with 78891b9dd93ae46d816cf04775cb2d4bfb07d4ba31ac5322e32db77eb59b5b0b not found: ID does not exist" Aug 05 19:31:47.001203 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.001171 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2"] Aug 05 19:31:47.008865 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.008836 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aaec4fc4-78d4584788-dfxp2"] Aug 05 19:31:47.026204 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.026168 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4"] Aug 05 19:31:47.029394 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.029364 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-aaec4fc4-84448994f8-hg8m4"] Aug 05 19:31:47.344198 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.344165 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7"] Aug 05 19:31:47.344652 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.344618 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1d301c-c0af-4acd-bbb7-cdffb9b94a53" containerName="payload-processing" Aug 05 19:31:47.344652 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.344631 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1d301c-c0af-4acd-bbb7-cdffb9b94a53" containerName="payload-processing" Aug 05 19:31:47.344652 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.344647 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956" containerName="payload-pre-processing" Aug 05 19:31:47.344652 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.344652 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956" containerName="payload-pre-processing" Aug 05 19:31:47.344902 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.344712 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1d301c-c0af-4acd-bbb7-cdffb9b94a53" containerName="payload-processing" Aug 05 19:31:47.344902 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.344725 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956" containerName="payload-pre-processing" Aug 05 19:31:47.349464 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.349437 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.352260 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.352240 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-bf1161af-gw-openshift-default-dockercfg-wh6qt\"" Aug 05 19:31:47.364494 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.364453 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7"] Aug 05 19:31:47.386704 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.386639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-podinfo\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.386936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.386744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66b6c\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-kube-api-access-66b6c\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.386936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.386818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-socket\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.387293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.387221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-data\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.387388 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.387309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-credential-socket\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.387388 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.387374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-envoy\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.387942 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.387562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-token\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.387942 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.387611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istiod-ca-cert\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.387942 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.387677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-certs\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.488968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.488923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66b6c\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-kube-api-access-66b6c\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.488968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.488968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-socket\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489232 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-data\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489232 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-credential-socket\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489232 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-envoy\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489232 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-token\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489438 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istiod-ca-cert\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489438 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-certs\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489438 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-podinfo\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489585 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489464 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-socket\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489585 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489521 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-data\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489689 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489589 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-credential-socket\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.489775 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.489733 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-certs\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.490049 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.490020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istiod-ca-cert\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.491526 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.491505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-envoy\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.491936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.491916 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-podinfo\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.498329 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.498292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-token\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.498510 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.498487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66b6c\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-kube-api-access-66b6c\") pod \"e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.661029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.660938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:47.814422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.814395 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7"] Aug 05 19:31:47.816318 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:31:47.816286 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c05038d_97cc_409f_b7ba_41d0daf3a5cd.slice/crio-052e01598ca5c3d03266133c0eb906e7af048af3d87ef8631c780f6f7cccfa04 WatchSource:0}: Error finding container 052e01598ca5c3d03266133c0eb906e7af048af3d87ef8631c780f6f7cccfa04: Status 404 returned error can't find the container with id 052e01598ca5c3d03266133c0eb906e7af048af3d87ef8631c780f6f7cccfa04 Aug 05 19:31:47.818590 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.818562 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:47.818659 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.818638 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:47.818701 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.818668 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:31:47.985144 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.985051 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" event={"ID":"4c05038d-97cc-409f-b7ba-41d0daf3a5cd","Type":"ContainerStarted","Data":"74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea"} Aug 05 19:31:47.985314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:47.985153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" event={"ID":"4c05038d-97cc-409f-b7ba-41d0daf3a5cd","Type":"ContainerStarted","Data":"052e01598ca5c3d03266133c0eb906e7af048af3d87ef8631c780f6f7cccfa04"} Aug 05 19:31:48.007466 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:48.007404 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podStartSLOduration=1.007386273 podStartE2EDuration="1.007386273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:31:48.005280539 +0000 UTC m=+1834.025343588" watchObservedRunningTime="2026-08-05 19:31:48.007386273 +0000 UTC m=+1834.027449321" Aug 05 19:31:48.539031 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:48.538993 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1d301c-c0af-4acd-bbb7-cdffb9b94a53" path="/var/lib/kubelet/pods/7e1d301c-c0af-4acd-bbb7-cdffb9b94a53/volumes" Aug 05 19:31:48.539438 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:48.539423 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956" path="/var/lib/kubelet/pods/f4a16e6b-d9b2-4ebc-8f8b-5ae084c6f956/volumes" Aug 05 19:31:48.662018 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:48.661984 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:48.667719 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:48.667690 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:48.991615 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:48.991579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:48.992583 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:48.992564 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:31:50.292637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:50.292596 2578 patch_prober.go:28] interesting pod/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 19:31:50.293040 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:50.292695 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 19:31:51.006383 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.006349 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq"] Aug 05 19:31:51.011132 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.011112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:51.019467 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.019437 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-bf1161af\"" Aug 05 19:31:51.019603 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.019498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-bf1161af-dockercfg-9hzvn\"" Aug 05 19:31:51.032402 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.032370 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq"] Aug 05 19:31:51.127185 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.127147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvf6l\" (UniqueName: \"kubernetes.io/projected/06453a10-7354-43af-bdbc-d9ccda0bea54-kube-api-access-kvf6l\") pod \"payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq\" (UID: \"06453a10-7354-43af-bdbc-d9ccda0bea54\") " pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:51.127364 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.127199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06453a10-7354-43af-bdbc-d9ccda0bea54-plugins-config-volume\") pod \"payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq\" (UID: \"06453a10-7354-43af-bdbc-d9ccda0bea54\") " pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:51.228388 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.228347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvf6l\" (UniqueName: \"kubernetes.io/projected/06453a10-7354-43af-bdbc-d9ccda0bea54-kube-api-access-kvf6l\") pod \"payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq\" (UID: \"06453a10-7354-43af-bdbc-d9ccda0bea54\") " pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:51.228388 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.228390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06453a10-7354-43af-bdbc-d9ccda0bea54-plugins-config-volume\") pod \"payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq\" (UID: \"06453a10-7354-43af-bdbc-d9ccda0bea54\") " pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:51.229200 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.229179 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06453a10-7354-43af-bdbc-d9ccda0bea54-plugins-config-volume\") pod \"payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq\" (UID: \"06453a10-7354-43af-bdbc-d9ccda0bea54\") " pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:51.244362 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.244327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvf6l\" (UniqueName: \"kubernetes.io/projected/06453a10-7354-43af-bdbc-d9ccda0bea54-kube-api-access-kvf6l\") pod \"payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq\" (UID: \"06453a10-7354-43af-bdbc-d9ccda0bea54\") " pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:51.322429 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.322391 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:51.501581 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.501551 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq"] Aug 05 19:31:51.503678 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:31:51.503642 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06453a10_7354_43af_bdbc_d9ccda0bea54.slice/crio-56ba451c1ce936e02713417251f90cb7a05dd2ce24e578a70a26d84939e5c091 WatchSource:0}: Error finding container 56ba451c1ce936e02713417251f90cb7a05dd2ce24e578a70a26d84939e5c091: Status 404 returned error can't find the container with id 56ba451c1ce936e02713417251f90cb7a05dd2ce24e578a70a26d84939e5c091 Aug 05 19:31:51.621029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.621001 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:51.733478 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733440 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-socket\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733681 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733500 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-token\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733681 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733591 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-data\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733681 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733624 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-credential-socket\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733681 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733652 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v857\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-kube-api-access-7v857\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733705 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-certs\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733732 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istiod-ca-cert\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733772 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-envoy\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733818 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-podinfo\") pod \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\" (UID: \"b9bdd13b-c363-4bed-b651-a0f6853d7ed4\") " Aug 05 19:31:51.733968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733824 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:31:51.733968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733946 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:31:51.733968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.733961 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:31:51.734302 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.734196 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:31:51.734302 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.734275 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:51.734405 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.734305 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:51.734405 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.734324 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:51.734405 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.734383 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:31:51.736057 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.736027 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-kube-api-access-7v857" (OuterVolumeSpecName: "kube-api-access-7v857") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "kube-api-access-7v857". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:31:51.736315 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.736284 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:31:51.736315 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.736300 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:31:51.736456 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.736436 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9bdd13b-c363-4bed-b651-a0f6853d7ed4" (UID: "b9bdd13b-c363-4bed-b651-a0f6853d7ed4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:31:51.835138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.835091 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v857\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-kube-api-access-7v857\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:51.835138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.835128 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:51.835138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.835137 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:51.835383 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.835161 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:51.835383 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.835170 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:51.835383 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:51.835178 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bdd13b-c363-4bed-b651-a0f6853d7ed4-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:31:52.011838 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.011727 2578 generic.go:356] "Generic (PLEG): container finished" podID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerID="b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92" exitCode=0 Aug 05 19:31:52.011838 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.011787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" event={"ID":"b9bdd13b-c363-4bed-b651-a0f6853d7ed4","Type":"ContainerDied","Data":"b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92"} Aug 05 19:31:52.011838 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.011816 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" Aug 05 19:31:52.012116 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.011860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs" event={"ID":"b9bdd13b-c363-4bed-b651-a0f6853d7ed4","Type":"ContainerDied","Data":"7e2799a557186586969d0fcda5ac05f78eaeb518461dc6b90888884df8291f2e"} Aug 05 19:31:52.012116 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.011892 2578 scope.go:117] "RemoveContainer" containerID="b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92" Aug 05 19:31:52.014033 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.014007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" event={"ID":"06453a10-7354-43af-bdbc-d9ccda0bea54","Type":"ContainerStarted","Data":"9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482"} Aug 05 19:31:52.014176 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.014053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" event={"ID":"06453a10-7354-43af-bdbc-d9ccda0bea54","Type":"ContainerStarted","Data":"56ba451c1ce936e02713417251f90cb7a05dd2ce24e578a70a26d84939e5c091"} Aug 05 19:31:52.014176 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.014107 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:31:52.023486 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.023465 2578 scope.go:117] "RemoveContainer" containerID="067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba" Aug 05 19:31:52.032674 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.032652 2578 scope.go:117] "RemoveContainer" containerID="b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92" Aug 05 19:31:52.032991 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:31:52.032971 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92\": container with ID starting with b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92 not found: ID does not exist" containerID="b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92" Aug 05 19:31:52.033045 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.033002 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92"} err="failed to get container status \"b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92\": rpc error: code = NotFound desc = could not find container \"b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92\": container with ID starting with b3b5e58e406792e9973b33b652b73e830543110746170ff3c5fcb17e8a87bb92 not found: ID does not exist" Aug 05 19:31:52.033045 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.033021 2578 scope.go:117] "RemoveContainer" containerID="067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba" Aug 05 19:31:52.033309 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:31:52.033285 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba\": container with ID starting with 067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba not found: ID does not exist" containerID="067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba" Aug 05 19:31:52.033346 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.033323 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba"} err="failed to get container status \"067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba\": rpc error: code = NotFound desc = could not find container \"067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba\": container with ID starting with 067952b1cb8de0465c5681f2d31bfc00224de38954dc9fa55a8dd4b8fbc524ba not found: ID does not exist" Aug 05 19:31:52.050120 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.050069 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" podStartSLOduration=2.050051282 podStartE2EDuration="2.050051282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:31:52.048656054 +0000 UTC m=+1838.068719101" watchObservedRunningTime="2026-08-05 19:31:52.050051282 +0000 UTC m=+1838.070114395" Aug 05 19:31:52.071463 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.071428 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs"] Aug 05 19:31:52.076892 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.076861 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aaec4fc4-openshift-default-778bd89d46-shxxs"] Aug 05 19:31:52.539733 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:31:52.539694 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" path="/var/lib/kubelet/pods/b9bdd13b-c363-4bed-b651-a0f6853d7ed4/volumes" Aug 05 19:32:03.023514 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:03.023481 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:32:03.993699 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:03.993610 2578 patch_prober.go:28] interesting pod/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Aug 05 19:32:03.993699 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:03.993669 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Aug 05 19:32:04.094418 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:04.094384 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerID="74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea" exitCode=0 Aug 05 19:32:04.094418 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:04.094429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" event={"ID":"4c05038d-97cc-409f-b7ba-41d0daf3a5cd","Type":"ContainerDied","Data":"74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea"} Aug 05 19:32:04.094904 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:04.094888 2578 scope.go:117] "RemoveContainer" containerID="74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea" Aug 05 19:32:04.096126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:04.096093 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:04.096205 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:04.096170 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:04.096244 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:04.096205 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:05.101648 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:05.101613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" event={"ID":"4c05038d-97cc-409f-b7ba-41d0daf3a5cd","Type":"ContainerStarted","Data":"c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f"} Aug 05 19:32:05.662063 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:05.662026 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:32:05.662369 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:05.662346 2578 patch_prober.go:28] interesting pod/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Aug 05 19:32:05.662460 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:05.662403 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Aug 05 19:32:06.662199 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:06.662154 2578 patch_prober.go:28] interesting pod/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Aug 05 19:32:06.662593 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:06.662226 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Aug 05 19:32:07.662023 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:07.661981 2578 patch_prober.go:28] interesting pod/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Aug 05 19:32:07.662219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:07.662043 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Aug 05 19:32:08.661991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:08.661950 2578 patch_prober.go:28] interesting pod/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Aug 05 19:32:08.662183 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:08.662032 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Aug 05 19:32:09.661724 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:09.661681 2578 patch_prober.go:28] interesting pod/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Aug 05 19:32:09.662208 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:09.661795 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Aug 05 19:32:10.666655 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:10.666616 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:32:10.667070 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:10.666969 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:32:10.667808 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:10.667788 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:32:21.391561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.391519 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq"] Aug 05 19:32:21.392211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.391779 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" podUID="06453a10-7354-43af-bdbc-d9ccda0bea54" containerName="payload-processing" containerID="cri-o://9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482" gracePeriod=30 Aug 05 19:32:21.667886 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.667854 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:32:21.753291 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.753253 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7"] Aug 05 19:32:21.753521 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.753471 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" containerID="cri-o://c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f" gracePeriod=30 Aug 05 19:32:21.836405 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.836366 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvf6l\" (UniqueName: \"kubernetes.io/projected/06453a10-7354-43af-bdbc-d9ccda0bea54-kube-api-access-kvf6l\") pod \"06453a10-7354-43af-bdbc-d9ccda0bea54\" (UID: \"06453a10-7354-43af-bdbc-d9ccda0bea54\") " Aug 05 19:32:21.836582 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.836436 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06453a10-7354-43af-bdbc-d9ccda0bea54-plugins-config-volume\") pod \"06453a10-7354-43af-bdbc-d9ccda0bea54\" (UID: \"06453a10-7354-43af-bdbc-d9ccda0bea54\") " Aug 05 19:32:21.836895 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.836862 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06453a10-7354-43af-bdbc-d9ccda0bea54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06453a10-7354-43af-bdbc-d9ccda0bea54" (UID: "06453a10-7354-43af-bdbc-d9ccda0bea54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:32:21.838680 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.838656 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06453a10-7354-43af-bdbc-d9ccda0bea54-kube-api-access-kvf6l" (OuterVolumeSpecName: "kube-api-access-kvf6l") pod "06453a10-7354-43af-bdbc-d9ccda0bea54" (UID: "06453a10-7354-43af-bdbc-d9ccda0bea54"). InnerVolumeSpecName "kube-api-access-kvf6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:32:21.938130 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.938097 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvf6l\" (UniqueName: \"kubernetes.io/projected/06453a10-7354-43af-bdbc-d9ccda0bea54-kube-api-access-kvf6l\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:21.938130 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:21.938129 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06453a10-7354-43af-bdbc-d9ccda0bea54-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:22.200056 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.199959 2578 generic.go:356] "Generic (PLEG): container finished" podID="06453a10-7354-43af-bdbc-d9ccda0bea54" containerID="9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482" exitCode=0 Aug 05 19:32:22.200056 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.200004 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" Aug 05 19:32:22.200056 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.200042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" event={"ID":"06453a10-7354-43af-bdbc-d9ccda0bea54","Type":"ContainerDied","Data":"9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482"} Aug 05 19:32:22.200329 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.200101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq" event={"ID":"06453a10-7354-43af-bdbc-d9ccda0bea54","Type":"ContainerDied","Data":"56ba451c1ce936e02713417251f90cb7a05dd2ce24e578a70a26d84939e5c091"} Aug 05 19:32:22.200329 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.200129 2578 scope.go:117] "RemoveContainer" containerID="9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482" Aug 05 19:32:22.209832 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.209819 2578 scope.go:117] "RemoveContainer" containerID="9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482" Aug 05 19:32:22.210136 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:32:22.210117 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482\": container with ID starting with 9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482 not found: ID does not exist" containerID="9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482" Aug 05 19:32:22.210211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.210142 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482"} err="failed to get container status \"9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482\": rpc error: code = NotFound desc = could not find container \"9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482\": container with ID starting with 9c8b4984da6dc29f9759dca65201665a4053884d1d58daae7508e532c9158482 not found: ID does not exist" Aug 05 19:32:22.226345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.226308 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq"] Aug 05 19:32:22.239335 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.239295 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-bf1161af-b5b9594b5-q6slq"] Aug 05 19:32:22.538677 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.538568 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06453a10-7354-43af-bdbc-d9ccda0bea54" path="/var/lib/kubelet/pods/06453a10-7354-43af-bdbc-d9ccda0bea54/volumes" Aug 05 19:32:22.539095 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.538931 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5"] Aug 05 19:32:22.539330 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539317 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" Aug 05 19:32:22.539372 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539331 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" Aug 05 19:32:22.539372 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539344 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" Aug 05 19:32:22.539372 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539350 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" Aug 05 19:32:22.539372 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539365 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06453a10-7354-43af-bdbc-d9ccda0bea54" containerName="payload-processing" Aug 05 19:32:22.539372 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539371 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="06453a10-7354-43af-bdbc-d9ccda0bea54" containerName="payload-processing" Aug 05 19:32:22.539562 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539434 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" Aug 05 19:32:22.539562 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539442 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bdd13b-c363-4bed-b651-a0f6853d7ed4" containerName="istio-proxy" Aug 05 19:32:22.539562 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.539450 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="06453a10-7354-43af-bdbc-d9ccda0bea54" containerName="payload-processing" Aug 05 19:32:22.544147 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.544123 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.548166 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.548141 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e3501887-openshift-default-dockercfg-ksvkj\"" Aug 05 19:32:22.560567 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.560535 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5"] Aug 05 19:32:22.645335 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-token\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.645559 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-certs\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.645559 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-socket\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.645559 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-podinfo\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.645738 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-credential-socket\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.645738 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d589c46-d996-4da4-acb1-c10fac7345a3-istiod-ca-cert\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.645738 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55vfd\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-kube-api-access-55vfd\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.645738 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-envoy\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.645930 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.645824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-data\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.746563 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.746525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-certs\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.746788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.746572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-socket\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.746788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.746611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-podinfo\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.746788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.746640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-credential-socket\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.746788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.746671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d589c46-d996-4da4-acb1-c10fac7345a3-istiod-ca-cert\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.746788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.746693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vfd\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-kube-api-access-55vfd\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.746788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.746734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-envoy\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.747127 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.746817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-data\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.747127 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.747014 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-certs\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.747127 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.747033 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-socket\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.747127 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.747075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-token\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.747351 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.747308 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-data\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.747351 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.747330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-credential-socket\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.747561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.747542 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d589c46-d996-4da4-acb1-c10fac7345a3-istiod-ca-cert\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.749205 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.749158 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-envoy\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.749337 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.749318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-podinfo\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.758737 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.758694 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vfd\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-kube-api-access-55vfd\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.759551 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.759526 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-token\") pod \"e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:22.855837 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:22.855784 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:23.015468 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:23.015440 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5"] Aug 05 19:32:23.017958 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:32:23.017927 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d589c46_d996_4da4_acb1_c10fac7345a3.slice/crio-a53a282db817ce1721bf69fb42b8c859457353f22a01bc4e86ccc75767391417 WatchSource:0}: Error finding container a53a282db817ce1721bf69fb42b8c859457353f22a01bc4e86ccc75767391417: Status 404 returned error can't find the container with id a53a282db817ce1721bf69fb42b8c859457353f22a01bc4e86ccc75767391417 Aug 05 19:32:23.020788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:23.020721 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:23.020862 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:23.020827 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:23.020906 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:23.020858 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:23.208895 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:23.208777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" event={"ID":"9d589c46-d996-4da4-acb1-c10fac7345a3","Type":"ContainerStarted","Data":"425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf"} Aug 05 19:32:23.208895 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:23.208851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" event={"ID":"9d589c46-d996-4da4-acb1-c10fac7345a3","Type":"ContainerStarted","Data":"a53a282db817ce1721bf69fb42b8c859457353f22a01bc4e86ccc75767391417"} Aug 05 19:32:23.237247 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:23.237182 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" podStartSLOduration=1.237162754 podStartE2EDuration="1.237162754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:32:23.23538255 +0000 UTC m=+1869.255445604" watchObservedRunningTime="2026-08-05 19:32:23.237162754 +0000 UTC m=+1869.257225801" Aug 05 19:32:23.856377 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:23.856336 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:24.862543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:24.862512 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:25.221703 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:25.221616 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:25.222831 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:25.222812 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:25.669379 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:25.669343 2578 patch_prober.go:28] interesting pod/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 19:32:25.669549 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:25.669406 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 19:32:27.027810 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.027715 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:32:27.193471 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193426 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-podinfo\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193471 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193478 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-envoy\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193504 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istiod-ca-cert\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193586 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-credential-socket\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193619 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-certs\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193649 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-data\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193948 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193726 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-token\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193948 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193809 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66b6c\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-kube-api-access-66b6c\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193948 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193835 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-socket\") pod \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\" (UID: \"4c05038d-97cc-409f-b7ba-41d0daf3a5cd\") " Aug 05 19:32:27.193948 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193891 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:32:27.194161 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.193959 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:32:27.194161 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.194030 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:32:27.194161 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.194089 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:32:27.194161 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.194149 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:32:27.194330 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.194307 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:27.194363 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.194337 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:27.194363 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.194353 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:27.194469 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.194368 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:27.194469 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.194380 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:27.195825 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.195791 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:32:27.196246 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.196153 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:32:27.196246 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.196206 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-kube-api-access-66b6c" (OuterVolumeSpecName: "kube-api-access-66b6c") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "kube-api-access-66b6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:32:27.196472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.196455 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c05038d-97cc-409f-b7ba-41d0daf3a5cd" (UID: "4c05038d-97cc-409f-b7ba-41d0daf3a5cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:32:27.234030 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.233995 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerID="c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f" exitCode=0 Aug 05 19:32:27.234222 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.234044 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" Aug 05 19:32:27.234222 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.234081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" event={"ID":"4c05038d-97cc-409f-b7ba-41d0daf3a5cd","Type":"ContainerDied","Data":"c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f"} Aug 05 19:32:27.234222 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.234141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7" event={"ID":"4c05038d-97cc-409f-b7ba-41d0daf3a5cd","Type":"ContainerDied","Data":"052e01598ca5c3d03266133c0eb906e7af048af3d87ef8631c780f6f7cccfa04"} Aug 05 19:32:27.234222 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.234165 2578 scope.go:117] "RemoveContainer" containerID="c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f" Aug 05 19:32:27.244273 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.244251 2578 scope.go:117] "RemoveContainer" containerID="74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea" Aug 05 19:32:27.253103 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.253083 2578 scope.go:117] "RemoveContainer" containerID="c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f" Aug 05 19:32:27.253407 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:32:27.253389 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f\": container with ID starting with c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f not found: ID does not exist" containerID="c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f" Aug 05 19:32:27.253473 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.253418 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f"} err="failed to get container status \"c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f\": rpc error: code = NotFound desc = could not find container \"c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f\": container with ID starting with c4574698948ea89c4cbf13530ba3a7721beb339ac6a06665a0e85a13ec91098f not found: ID does not exist" Aug 05 19:32:27.253473 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.253436 2578 scope.go:117] "RemoveContainer" containerID="74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea" Aug 05 19:32:27.253706 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:32:27.253674 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea\": container with ID starting with 74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea not found: ID does not exist" containerID="74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea" Aug 05 19:32:27.253806 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.253704 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea"} err="failed to get container status \"74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea\": rpc error: code = NotFound desc = could not find container \"74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea\": container with ID starting with 74cfded46ac6e181af61a5a44118850cfd610517f343246be84518bf2ec61eea not found: ID does not exist" Aug 05 19:32:27.266394 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.266362 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7"] Aug 05 19:32:27.279299 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.279218 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-bf1161af-gw-openshift-default-5764554f48-w5dl7"] Aug 05 19:32:27.294962 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.294927 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:27.294962 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.294959 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66b6c\" (UniqueName: \"kubernetes.io/projected/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-kube-api-access-66b6c\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:27.295165 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.294971 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:27.295165 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:27.294981 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c05038d-97cc-409f-b7ba-41d0daf3a5cd-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:32:28.538117 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:28.538081 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" path="/var/lib/kubelet/pods/4c05038d-97cc-409f-b7ba-41d0daf3a5cd/volumes" Aug 05 19:32:39.302453 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:39.302420 2578 generic.go:356] "Generic (PLEG): container finished" podID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerID="425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf" exitCode=0 Aug 05 19:32:39.302917 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:39.302495 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" event={"ID":"9d589c46-d996-4da4-acb1-c10fac7345a3","Type":"ContainerDied","Data":"425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf"} Aug 05 19:32:39.302974 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:39.302955 2578 scope.go:117] "RemoveContainer" containerID="425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf" Aug 05 19:32:39.304014 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:39.303986 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:39.304118 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:39.304078 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:39.304118 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:39.304110 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:40.221720 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:40.221673 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:40.309805 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:40.309729 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" event={"ID":"9d589c46-d996-4da4-acb1-c10fac7345a3","Type":"ContainerStarted","Data":"be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0"} Aug 05 19:32:40.857020 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:40.856975 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:40.858136 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:40.858109 2578 patch_prober.go:28] interesting pod/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Aug 05 19:32:40.858233 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:40.858164 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Aug 05 19:32:41.856668 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:41.856621 2578 patch_prober.go:28] interesting pod/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Aug 05 19:32:41.857096 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:41.856684 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Aug 05 19:32:42.856539 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:42.856496 2578 patch_prober.go:28] interesting pod/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Aug 05 19:32:42.856736 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:42.856557 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Aug 05 19:32:43.856870 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:43.856826 2578 patch_prober.go:28] interesting pod/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Aug 05 19:32:43.857279 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:43.856889 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Aug 05 19:32:44.856410 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:44.856368 2578 patch_prober.go:28] interesting pod/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Aug 05 19:32:44.856606 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:44.856435 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Aug 05 19:32:45.860164 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:45.860131 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:45.860589 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:45.860410 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:45.861269 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:45.861250 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:32:58.180391 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:58.180352 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5"] Aug 05 19:32:58.181043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:58.180605 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" containerID="cri-o://be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0" gracePeriod=30 Aug 05 19:32:59.002765 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.002720 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6"] Aug 05 19:32:59.003208 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.003192 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" Aug 05 19:32:59.003260 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.003209 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" Aug 05 19:32:59.003260 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.003220 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" Aug 05 19:32:59.003260 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.003226 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" Aug 05 19:32:59.003359 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.003307 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" Aug 05 19:32:59.003359 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.003319 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c05038d-97cc-409f-b7ba-41d0daf3a5cd" containerName="istio-proxy" Aug 05 19:32:59.006565 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.006547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.012422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.012395 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-61891be0-openshift-default-dockercfg-5ddw4\"" Aug 05 19:32:59.031655 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.031627 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6"] Aug 05 19:32:59.114198 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-certs\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.114198 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-token\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.114425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpctf\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-kube-api-access-lpctf\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.114425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-envoy\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.114425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-podinfo\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.114425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-socket\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.114425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25e54c4-87f0-4a6f-8618-83928f655d93-istiod-ca-cert\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.114425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-data\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.114425 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.114395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-credential-socket\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.215685 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.215646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpctf\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-kube-api-access-lpctf\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216170 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.215693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-envoy\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216170 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.215719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-podinfo\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216170 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.215903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-socket\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216170 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.215991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25e54c4-87f0-4a6f-8618-83928f655d93-istiod-ca-cert\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216170 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-data\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216170 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216061 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-credential-socket\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216496 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-certs\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216496 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-token\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216496 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-socket\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216496 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216390 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-data\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216706 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216586 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-certs\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216706 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216628 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-credential-socket\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.216848 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.216825 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25e54c4-87f0-4a6f-8618-83928f655d93-istiod-ca-cert\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.218690 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.218669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-envoy\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.218865 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.218845 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-podinfo\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.236997 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.236965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-token\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.237536 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.237519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpctf\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-kube-api-access-lpctf\") pod \"e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.316927 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.316891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:32:59.495132 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.495103 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6"] Aug 05 19:32:59.497029 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:32:59.497000 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25e54c4_87f0_4a6f_8618_83928f655d93.slice/crio-ab70d1c514e7df04e11033cb1368c345a554a5c402bdd64edb22a26f5838b1ca WatchSource:0}: Error finding container ab70d1c514e7df04e11033cb1368c345a554a5c402bdd64edb22a26f5838b1ca: Status 404 returned error can't find the container with id ab70d1c514e7df04e11033cb1368c345a554a5c402bdd64edb22a26f5838b1ca Aug 05 19:32:59.499256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.499218 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:59.499322 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.499291 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:32:59.499358 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:32:59.499325 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:33:00.424012 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:00.423956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" event={"ID":"e25e54c4-87f0-4a6f-8618-83928f655d93","Type":"ContainerStarted","Data":"7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454"} Aug 05 19:33:00.424499 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:00.424035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" event={"ID":"e25e54c4-87f0-4a6f-8618-83928f655d93","Type":"ContainerStarted","Data":"ab70d1c514e7df04e11033cb1368c345a554a5c402bdd64edb22a26f5838b1ca"} Aug 05 19:33:00.467672 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:00.467617 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podStartSLOduration=2.467600796 podStartE2EDuration="2.467600796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:33:00.467194908 +0000 UTC m=+1906.487257955" watchObservedRunningTime="2026-08-05 19:33:00.467600796 +0000 UTC m=+1906.487663844" Aug 05 19:33:00.863620 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:00.863575 2578 patch_prober.go:28] interesting pod/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 19:33:00.863813 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:00.863636 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 19:33:01.318127 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:01.318085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:01.323648 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:01.323622 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:01.429908 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:01.429874 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:01.430963 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:01.430944 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:03.439022 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.438992 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:33:03.441016 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.440987 2578 generic.go:356] "Generic (PLEG): container finished" podID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerID="be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0" exitCode=0 Aug 05 19:33:03.441130 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.441039 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" Aug 05 19:33:03.441130 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.441071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" event={"ID":"9d589c46-d996-4da4-acb1-c10fac7345a3","Type":"ContainerDied","Data":"be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0"} Aug 05 19:33:03.441130 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.441124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5" event={"ID":"9d589c46-d996-4da4-acb1-c10fac7345a3","Type":"ContainerDied","Data":"a53a282db817ce1721bf69fb42b8c859457353f22a01bc4e86ccc75767391417"} Aug 05 19:33:03.441241 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.441146 2578 scope.go:117] "RemoveContainer" containerID="be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0" Aug 05 19:33:03.450125 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.450104 2578 scope.go:117] "RemoveContainer" containerID="425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf" Aug 05 19:33:03.460627 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.460555 2578 scope.go:117] "RemoveContainer" containerID="be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0" Aug 05 19:33:03.460921 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:33:03.460900 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0\": container with ID starting with be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0 not found: ID does not exist" containerID="be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0" Aug 05 19:33:03.461017 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.460937 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0"} err="failed to get container status \"be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0\": rpc error: code = NotFound desc = could not find container \"be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0\": container with ID starting with be38a37fb786ea37fe26cf7159ea4d3538382bbefb03a2c4f9eeb9dbd02afaf0 not found: ID does not exist" Aug 05 19:33:03.461017 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.460962 2578 scope.go:117] "RemoveContainer" containerID="425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf" Aug 05 19:33:03.461255 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:33:03.461226 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf\": container with ID starting with 425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf not found: ID does not exist" containerID="425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf" Aug 05 19:33:03.461316 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.461260 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf"} err="failed to get container status \"425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf\": rpc error: code = NotFound desc = could not find container \"425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf\": container with ID starting with 425ca389d0b2e4756a3e421e4837b15e696cdd5301e3de7495501ad25d824fbf not found: ID does not exist" Aug 05 19:33:03.561939 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.561906 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d589c46-d996-4da4-acb1-c10fac7345a3-istiod-ca-cert\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.561984 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-certs\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562015 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-data\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562048 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55vfd\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-kube-api-access-55vfd\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562091 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-socket\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562149 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-podinfo\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562295 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-token\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562335 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:03.562472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562349 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:03.562472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562365 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-envoy\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562339 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d589c46-d996-4da4-acb1-c10fac7345a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:33:03.562472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562434 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:03.562472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562447 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-credential-socket\") pod \"9d589c46-d996-4da4-acb1-c10fac7345a3\" (UID: \"9d589c46-d996-4da4-acb1-c10fac7345a3\") " Aug 05 19:33:03.562909 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.562727 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:03.563142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.563082 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.563282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.563143 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.563282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.563182 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.563282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.563195 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.563282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.563210 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d589c46-d996-4da4-acb1-c10fac7345a3-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.564683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.564659 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:03.564827 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.564683 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:33:03.564887 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.564865 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-kube-api-access-55vfd" (OuterVolumeSpecName: "kube-api-access-55vfd") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "kube-api-access-55vfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:33:03.564972 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.564948 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d589c46-d996-4da4-acb1-c10fac7345a3" (UID: "9d589c46-d996-4da4-acb1-c10fac7345a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:33:03.663991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.663955 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55vfd\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-kube-api-access-55vfd\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.663991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.663985 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.663991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.663996 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.664278 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.664004 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d589c46-d996-4da4-acb1-c10fac7345a3-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:03.774726 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.774689 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5"] Aug 05 19:33:03.779353 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.779319 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e3501887-openshift-default-598c7dc54b-l7kl5"] Aug 05 19:33:03.927450 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.927414 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn"] Aug 05 19:33:03.927905 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.927891 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" Aug 05 19:33:03.927964 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.927908 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" Aug 05 19:33:03.927964 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.927918 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" Aug 05 19:33:03.927964 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.927924 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" Aug 05 19:33:03.928074 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.927996 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" Aug 05 19:33:03.932677 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.932658 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:03.937886 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.937856 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-61891be0\"" Aug 05 19:33:03.939937 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.939846 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-61891be0-dockercfg-xd7js\"" Aug 05 19:33:03.941471 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:03.941447 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn"] Aug 05 19:33:04.068437 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.068393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txfcx\" (UniqueName: \"kubernetes.io/projected/8373cadd-a667-4304-9197-9a2f5f675188-kube-api-access-txfcx\") pod \"payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn\" (UID: \"8373cadd-a667-4304-9197-9a2f5f675188\") " pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:04.068607 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.068563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8373cadd-a667-4304-9197-9a2f5f675188-plugins-config-volume\") pod \"payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn\" (UID: \"8373cadd-a667-4304-9197-9a2f5f675188\") " pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:04.169990 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.169947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8373cadd-a667-4304-9197-9a2f5f675188-plugins-config-volume\") pod \"payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn\" (UID: \"8373cadd-a667-4304-9197-9a2f5f675188\") " pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:04.170181 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.170004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txfcx\" (UniqueName: \"kubernetes.io/projected/8373cadd-a667-4304-9197-9a2f5f675188-kube-api-access-txfcx\") pod \"payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn\" (UID: \"8373cadd-a667-4304-9197-9a2f5f675188\") " pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:04.170712 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.170688 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8373cadd-a667-4304-9197-9a2f5f675188-plugins-config-volume\") pod \"payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn\" (UID: \"8373cadd-a667-4304-9197-9a2f5f675188\") " pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:04.180389 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.180363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txfcx\" (UniqueName: \"kubernetes.io/projected/8373cadd-a667-4304-9197-9a2f5f675188-kube-api-access-txfcx\") pod \"payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn\" (UID: \"8373cadd-a667-4304-9197-9a2f5f675188\") " pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:04.245547 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.245503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:04.407839 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.407809 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn"] Aug 05 19:33:04.409919 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:33:04.409890 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8373cadd_a667_4304_9197_9a2f5f675188.slice/crio-0ed88178c71a96a20d2a07d4ad13e73d3320912157038b297c725aa545fa8d02 WatchSource:0}: Error finding container 0ed88178c71a96a20d2a07d4ad13e73d3320912157038b297c725aa545fa8d02: Status 404 returned error can't find the container with id 0ed88178c71a96a20d2a07d4ad13e73d3320912157038b297c725aa545fa8d02 Aug 05 19:33:04.448319 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.448283 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" event={"ID":"8373cadd-a667-4304-9197-9a2f5f675188","Type":"ContainerStarted","Data":"0ed88178c71a96a20d2a07d4ad13e73d3320912157038b297c725aa545fa8d02"} Aug 05 19:33:04.539236 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:04.539201 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" path="/var/lib/kubelet/pods/9d589c46-d996-4da4-acb1-c10fac7345a3/volumes" Aug 05 19:33:05.455830 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:05.455783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" event={"ID":"8373cadd-a667-4304-9197-9a2f5f675188","Type":"ContainerStarted","Data":"0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af"} Aug 05 19:33:05.456214 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:05.455863 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:05.474270 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:05.474214 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" podStartSLOduration=2.474194153 podStartE2EDuration="2.474194153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:33:05.473637812 +0000 UTC m=+1911.493700861" watchObservedRunningTime="2026-08-05 19:33:05.474194153 +0000 UTC m=+1911.494257200" Aug 05 19:33:16.432030 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.431991 2578 patch_prober.go:28] interesting pod/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Aug 05 19:33:16.432435 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.432059 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Aug 05 19:33:16.464418 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.464381 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:16.518214 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.518181 2578 generic.go:356] "Generic (PLEG): container finished" podID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerID="7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454" exitCode=0 Aug 05 19:33:16.518415 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.518252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" event={"ID":"e25e54c4-87f0-4a6f-8618-83928f655d93","Type":"ContainerDied","Data":"7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454"} Aug 05 19:33:16.518791 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.518737 2578 scope.go:117] "RemoveContainer" containerID="7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454" Aug 05 19:33:16.520155 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.520114 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:33:16.520249 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.520217 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:33:16.520289 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:16.520264 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:33:17.527176 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:17.527132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" event={"ID":"e25e54c4-87f0-4a6f-8618-83928f655d93","Type":"ContainerStarted","Data":"3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4"} Aug 05 19:33:18.317680 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:18.317639 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:18.317894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:18.317858 2578 patch_prober.go:28] interesting pod/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Aug 05 19:33:18.317946 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:18.317926 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Aug 05 19:33:19.317985 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:19.317937 2578 patch_prober.go:28] interesting pod/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Aug 05 19:33:19.318477 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:19.318019 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Aug 05 19:33:20.317329 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:20.317286 2578 patch_prober.go:28] interesting pod/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Aug 05 19:33:20.317511 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:20.317360 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Aug 05 19:33:21.317358 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:21.317320 2578 patch_prober.go:28] interesting pod/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Aug 05 19:33:21.317792 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:21.317377 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Aug 05 19:33:22.318108 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:22.318072 2578 patch_prober.go:28] interesting pod/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Aug 05 19:33:22.318512 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:22.318132 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Aug 05 19:33:23.322175 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:23.322141 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:23.322678 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:23.322548 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:23.323337 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:23.323314 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:34.093267 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.093227 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn"] Aug 05 19:33:34.094152 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.094119 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" podUID="8373cadd-a667-4304-9197-9a2f5f675188" containerName="payload-processing" containerID="cri-o://0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af" gracePeriod=30 Aug 05 19:33:34.371421 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.371392 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:34.477516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.477476 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8373cadd-a667-4304-9197-9a2f5f675188-plugins-config-volume\") pod \"8373cadd-a667-4304-9197-9a2f5f675188\" (UID: \"8373cadd-a667-4304-9197-9a2f5f675188\") " Aug 05 19:33:34.477691 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.477649 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txfcx\" (UniqueName: \"kubernetes.io/projected/8373cadd-a667-4304-9197-9a2f5f675188-kube-api-access-txfcx\") pod \"8373cadd-a667-4304-9197-9a2f5f675188\" (UID: \"8373cadd-a667-4304-9197-9a2f5f675188\") " Aug 05 19:33:34.477916 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.477892 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8373cadd-a667-4304-9197-9a2f5f675188-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8373cadd-a667-4304-9197-9a2f5f675188" (UID: "8373cadd-a667-4304-9197-9a2f5f675188"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:33:34.478059 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.478029 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8373cadd-a667-4304-9197-9a2f5f675188-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:34.479703 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.479679 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8373cadd-a667-4304-9197-9a2f5f675188-kube-api-access-txfcx" (OuterVolumeSpecName: "kube-api-access-txfcx") pod "8373cadd-a667-4304-9197-9a2f5f675188" (UID: "8373cadd-a667-4304-9197-9a2f5f675188"). InnerVolumeSpecName "kube-api-access-txfcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:33:34.578989 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.578955 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txfcx\" (UniqueName: \"kubernetes.io/projected/8373cadd-a667-4304-9197-9a2f5f675188-kube-api-access-txfcx\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:34.623391 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.623295 2578 generic.go:356] "Generic (PLEG): container finished" podID="8373cadd-a667-4304-9197-9a2f5f675188" containerID="0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af" exitCode=0 Aug 05 19:33:34.623391 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.623346 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" Aug 05 19:33:34.623591 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.623383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" event={"ID":"8373cadd-a667-4304-9197-9a2f5f675188","Type":"ContainerDied","Data":"0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af"} Aug 05 19:33:34.623591 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.623444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn" event={"ID":"8373cadd-a667-4304-9197-9a2f5f675188","Type":"ContainerDied","Data":"0ed88178c71a96a20d2a07d4ad13e73d3320912157038b297c725aa545fa8d02"} Aug 05 19:33:34.623591 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.623475 2578 scope.go:117] "RemoveContainer" containerID="0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af" Aug 05 19:33:34.633111 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.633085 2578 scope.go:117] "RemoveContainer" containerID="0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af" Aug 05 19:33:34.633446 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:33:34.633412 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af\": container with ID starting with 0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af not found: ID does not exist" containerID="0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af" Aug 05 19:33:34.633522 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.633457 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af"} err="failed to get container status \"0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af\": rpc error: code = NotFound desc = could not find container \"0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af\": container with ID starting with 0df006e20fd445e7f40defa9ea435f24048df6e447a7ce1f5290eb8a9749e2af not found: ID does not exist" Aug 05 19:33:34.655839 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.655811 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6"] Aug 05 19:33:34.656037 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.656020 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" containerID="cri-o://3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4" gracePeriod=30 Aug 05 19:33:34.666308 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.666281 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn"] Aug 05 19:33:34.678934 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:34.678903 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-61891be0-7489b68b98-mb9hn"] Aug 05 19:33:36.538585 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:36.538545 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8373cadd-a667-4304-9197-9a2f5f675188" path="/var/lib/kubelet/pods/8373cadd-a667-4304-9197-9a2f5f675188/volumes" Aug 05 19:33:38.325122 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:38.325079 2578 patch_prober.go:28] interesting pod/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 19:33:38.325501 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:38.325153 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 19:33:39.922961 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:39.922886 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:40.034238 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034201 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-socket\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034248 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpctf\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-kube-api-access-lpctf\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034272 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-certs\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034305 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25e54c4-87f0-4a6f-8618-83928f655d93-istiod-ca-cert\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034334 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-envoy\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034353 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-podinfo\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034368 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-data\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034420 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-credential-socket\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034779 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034466 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-token\") pod \"e25e54c4-87f0-4a6f-8618-83928f655d93\" (UID: \"e25e54c4-87f0-4a6f-8618-83928f655d93\") " Aug 05 19:33:40.034779 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034544 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:40.034894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034781 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-data" (OuterVolumeSpecName: "istio-data") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:40.034894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034808 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:40.034894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034870 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.035065 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.034969 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:40.035186 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.035163 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e25e54c4-87f0-4a6f-8618-83928f655d93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:33:40.036609 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.036585 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-kube-api-access-lpctf" (OuterVolumeSpecName: "kube-api-access-lpctf") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "kube-api-access-lpctf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:33:40.036709 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.036666 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:33:40.037064 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.037038 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:33:40.037163 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.037060 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-token" (OuterVolumeSpecName: "istio-token") pod "e25e54c4-87f0-4a6f-8618-83928f655d93" (UID: "e25e54c4-87f0-4a6f-8618-83928f655d93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:33:40.135615 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.135576 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.135615 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.135611 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpctf\" (UniqueName: \"kubernetes.io/projected/e25e54c4-87f0-4a6f-8618-83928f655d93-kube-api-access-lpctf\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.135615 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.135621 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.135615 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.135630 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e25e54c4-87f0-4a6f-8618-83928f655d93-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.135929 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.135639 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.135929 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.135647 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.135929 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.135654 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.135929 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.135662 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e25e54c4-87f0-4a6f-8618-83928f655d93-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:33:40.668274 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.668232 2578 generic.go:356] "Generic (PLEG): container finished" podID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerID="3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4" exitCode=0 Aug 05 19:33:40.668463 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.668291 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" Aug 05 19:33:40.668463 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.668296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" event={"ID":"e25e54c4-87f0-4a6f-8618-83928f655d93","Type":"ContainerDied","Data":"3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4"} Aug 05 19:33:40.668463 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.668370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6" event={"ID":"e25e54c4-87f0-4a6f-8618-83928f655d93","Type":"ContainerDied","Data":"ab70d1c514e7df04e11033cb1368c345a554a5c402bdd64edb22a26f5838b1ca"} Aug 05 19:33:40.668463 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.668407 2578 scope.go:117] "RemoveContainer" containerID="3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4" Aug 05 19:33:40.680601 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.680581 2578 scope.go:117] "RemoveContainer" containerID="7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454" Aug 05 19:33:40.691510 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.691484 2578 scope.go:117] "RemoveContainer" containerID="3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4" Aug 05 19:33:40.691879 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:33:40.691858 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4\": container with ID starting with 3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4 not found: ID does not exist" containerID="3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4" Aug 05 19:33:40.691960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.691891 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4"} err="failed to get container status \"3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4\": rpc error: code = NotFound desc = could not find container \"3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4\": container with ID starting with 3645280e01cfe8c501b49b9f79624a49d0ef81e5574688492bd1c2ce3152dee4 not found: ID does not exist" Aug 05 19:33:40.691960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.691912 2578 scope.go:117] "RemoveContainer" containerID="7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454" Aug 05 19:33:40.692226 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:33:40.692199 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454\": container with ID starting with 7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454 not found: ID does not exist" containerID="7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454" Aug 05 19:33:40.692283 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.692237 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454"} err="failed to get container status \"7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454\": rpc error: code = NotFound desc = could not find container \"7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454\": container with ID starting with 7084f6e70bfc8748c31c250664538613110c45fa7baa0b8b8bc84112c4919454 not found: ID does not exist" Aug 05 19:33:40.704086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.704058 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6"] Aug 05 19:33:40.717814 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:40.717785 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-61891be0-openshift-default-66c9456c44-qcpv6"] Aug 05 19:33:42.538501 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:33:42.538467 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" path="/var/lib/kubelet/pods/e25e54c4-87f0-4a6f-8618-83928f655d93/volumes" Aug 05 19:35:33.529495 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.529461 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk"] Aug 05 19:35:33.530144 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530120 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" Aug 05 19:35:33.530227 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530148 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" Aug 05 19:35:33.530227 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530185 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8373cadd-a667-4304-9197-9a2f5f675188" containerName="payload-processing" Aug 05 19:35:33.530227 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530196 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8373cadd-a667-4304-9197-9a2f5f675188" containerName="payload-processing" Aug 05 19:35:33.530227 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530207 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" Aug 05 19:35:33.530227 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530216 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" Aug 05 19:35:33.530472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530316 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d589c46-d996-4da4-acb1-c10fac7345a3" containerName="istio-proxy" Aug 05 19:35:33.530472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530330 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8373cadd-a667-4304-9197-9a2f5f675188" containerName="payload-processing" Aug 05 19:35:33.530472 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.530344 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" Aug 05 19:35:33.533626 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.533602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.536322 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.536291 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-82a4c5b4-openshift-default-dockercfg-swgjc\"" Aug 05 19:35:33.553507 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.553472 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk"] Aug 05 19:35:33.618384 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-envoy\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.618602 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-data\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.618602 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h66wv\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-kube-api-access-h66wv\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.618602 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-credential-socket\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.618602 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618595 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2844ab4-a504-484e-9877-dcd2f0a064d1-istiod-ca-cert\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.618858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-podinfo\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.618858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-socket\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.618858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-token\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.618858 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.618826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-certs\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720313 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-data\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h66wv\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-kube-api-access-h66wv\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-credential-socket\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2844ab4-a504-484e-9877-dcd2f0a064d1-istiod-ca-cert\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-podinfo\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-socket\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-token\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720874 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-certs\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720874 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-envoy\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720874 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720721 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-data\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.720874 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.720829 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-credential-socket\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.721119 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.721092 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2844ab4-a504-484e-9877-dcd2f0a064d1-istiod-ca-cert\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.721180 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.721109 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-socket\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.721219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.721192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-certs\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.723321 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.723295 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-envoy\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.723731 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.723708 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-podinfo\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.728923 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.728896 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h66wv\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-kube-api-access-h66wv\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.729048 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.728953 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-token\") pod \"e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.845174 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.845132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:33.998191 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:33.998159 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk"] Aug 05 19:35:34.000423 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:35:34.000395 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2844ab4_a504_484e_9877_dcd2f0a064d1.slice/crio-ca0704882073ae05675817329b59bd4e4fe7340da2f46591de4223bf96e3fe27 WatchSource:0}: Error finding container ca0704882073ae05675817329b59bd4e4fe7340da2f46591de4223bf96e3fe27: Status 404 returned error can't find the container with id ca0704882073ae05675817329b59bd4e4fe7340da2f46591de4223bf96e3fe27 Aug 05 19:35:34.002875 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:34.002842 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:35:34.002995 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:34.002934 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:35:34.002995 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:34.002965 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:35:34.267208 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:34.267121 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" event={"ID":"e2844ab4-a504-484e-9877-dcd2f0a064d1","Type":"ContainerStarted","Data":"a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101"} Aug 05 19:35:34.267360 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:34.267209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" event={"ID":"e2844ab4-a504-484e-9877-dcd2f0a064d1","Type":"ContainerStarted","Data":"ca0704882073ae05675817329b59bd4e4fe7340da2f46591de4223bf96e3fe27"} Aug 05 19:35:34.287775 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:34.287695 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" podStartSLOduration=1.287675643 podStartE2EDuration="1.287675643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:35:34.285628548 +0000 UTC m=+2060.305691620" watchObservedRunningTime="2026-08-05 19:35:34.287675643 +0000 UTC m=+2060.307738691" Aug 05 19:35:34.845888 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:34.845847 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:35.851785 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:35.851715 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:36.278665 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:36.278574 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:36.279804 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:36.279783 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:38.072082 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.072044 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9"] Aug 05 19:35:38.072550 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.072535 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e25e54c4-87f0-4a6f-8618-83928f655d93" containerName="istio-proxy" Aug 05 19:35:38.075930 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.075907 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:38.078561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.078539 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-82a4c5b4-dockercfg-gnx8k\"" Aug 05 19:35:38.078798 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.078774 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-82a4c5b4\"" Aug 05 19:35:38.084765 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.084717 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9"] Aug 05 19:35:38.165836 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.165795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9\" (UID: \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:38.166056 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.165926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rc5\" (UniqueName: \"kubernetes.io/projected/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-kube-api-access-29rc5\") pod \"payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9\" (UID: \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:38.267183 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.267136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9\" (UID: \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:38.267413 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.267240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29rc5\" (UniqueName: \"kubernetes.io/projected/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-kube-api-access-29rc5\") pod \"payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9\" (UID: \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:38.268004 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.267977 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9\" (UID: \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:38.275518 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.275490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rc5\" (UniqueName: \"kubernetes.io/projected/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-kube-api-access-29rc5\") pod \"payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9\" (UID: \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:38.388396 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.388292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:38.541436 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:38.541366 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9"] Aug 05 19:35:38.543719 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:35:38.543690 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92de5933_6ed2_4709_b1c0_b3d9cd7420d1.slice/crio-adbc5009a4aab183638950a7d4d9f032d69340b98e18aef21e7dbcdc0b77f319 WatchSource:0}: Error finding container adbc5009a4aab183638950a7d4d9f032d69340b98e18aef21e7dbcdc0b77f319: Status 404 returned error can't find the container with id adbc5009a4aab183638950a7d4d9f032d69340b98e18aef21e7dbcdc0b77f319 Aug 05 19:35:39.297038 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:39.296869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" event={"ID":"92de5933-6ed2-4709-b1c0-b3d9cd7420d1","Type":"ContainerStarted","Data":"5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc"} Aug 05 19:35:39.297038 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:39.296967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" event={"ID":"92de5933-6ed2-4709-b1c0-b3d9cd7420d1","Type":"ContainerStarted","Data":"adbc5009a4aab183638950a7d4d9f032d69340b98e18aef21e7dbcdc0b77f319"} Aug 05 19:35:39.297804 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:39.297782 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:39.316605 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:39.316530 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" podStartSLOduration=1.3165083229999999 podStartE2EDuration="1.316508323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:35:39.314245855 +0000 UTC m=+2065.334308917" watchObservedRunningTime="2026-08-05 19:35:39.316508323 +0000 UTC m=+2065.336571371" Aug 05 19:35:50.369493 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:50.369410 2578 generic.go:356] "Generic (PLEG): container finished" podID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerID="a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101" exitCode=0 Aug 05 19:35:50.369493 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:50.369481 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" event={"ID":"e2844ab4-a504-484e-9877-dcd2f0a064d1","Type":"ContainerDied","Data":"a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101"} Aug 05 19:35:50.369952 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:50.369935 2578 scope.go:117] "RemoveContainer" containerID="a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101" Aug 05 19:35:50.370996 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:50.370965 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:35:50.371074 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:50.371056 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:35:50.371117 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:50.371104 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:35:51.279509 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:51.279451 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:51.310921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:51.310881 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:35:51.376837 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:51.376802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" event={"ID":"e2844ab4-a504-484e-9877-dcd2f0a064d1","Type":"ContainerStarted","Data":"86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7"} Aug 05 19:35:51.845450 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:51.845408 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:51.846651 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:51.846617 2578 patch_prober.go:28] interesting pod/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Aug 05 19:35:51.846923 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:51.846869 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Aug 05 19:35:52.846345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:52.846295 2578 patch_prober.go:28] interesting pod/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Aug 05 19:35:52.846875 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:52.846372 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Aug 05 19:35:53.846221 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:53.846163 2578 patch_prober.go:28] interesting pod/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Aug 05 19:35:53.847259 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:53.846570 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Aug 05 19:35:54.846341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:54.846299 2578 patch_prober.go:28] interesting pod/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Aug 05 19:35:54.846649 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:54.846615 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Aug 05 19:35:55.845943 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:55.845890 2578 patch_prober.go:28] interesting pod/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Aug 05 19:35:55.846505 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:55.845967 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Aug 05 19:35:56.850073 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:56.850040 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:56.850576 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:56.850439 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:35:56.851196 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:35:56.851174 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:36:14.622162 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:14.622132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:36:14.626490 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:14.626460 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:36:18.903236 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:18.903201 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9"] Aug 05 19:36:18.903681 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:18.903469 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" podUID="92de5933-6ed2-4709-b1c0-b3d9cd7420d1" containerName="payload-pre-processing" containerID="cri-o://5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc" gracePeriod=30 Aug 05 19:36:19.183576 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.183533 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:36:19.280191 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.280153 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29rc5\" (UniqueName: \"kubernetes.io/projected/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-kube-api-access-29rc5\") pod \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\" (UID: \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\") " Aug 05 19:36:19.280386 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.280264 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-plugins-config-volume\") pod \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\" (UID: \"92de5933-6ed2-4709-b1c0-b3d9cd7420d1\") " Aug 05 19:36:19.280716 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.280687 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92de5933-6ed2-4709-b1c0-b3d9cd7420d1" (UID: "92de5933-6ed2-4709-b1c0-b3d9cd7420d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:36:19.282277 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.282250 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-kube-api-access-29rc5" (OuterVolumeSpecName: "kube-api-access-29rc5") pod "92de5933-6ed2-4709-b1c0-b3d9cd7420d1" (UID: "92de5933-6ed2-4709-b1c0-b3d9cd7420d1"). InnerVolumeSpecName "kube-api-access-29rc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:36:19.381496 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.381458 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29rc5\" (UniqueName: \"kubernetes.io/projected/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-kube-api-access-29rc5\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:19.381496 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.381494 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92de5933-6ed2-4709-b1c0-b3d9cd7420d1-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:19.525744 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.525657 2578 generic.go:356] "Generic (PLEG): container finished" podID="92de5933-6ed2-4709-b1c0-b3d9cd7420d1" containerID="5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc" exitCode=0 Aug 05 19:36:19.525744 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.525706 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" Aug 05 19:36:19.525744 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.525732 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" event={"ID":"92de5933-6ed2-4709-b1c0-b3d9cd7420d1","Type":"ContainerDied","Data":"5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc"} Aug 05 19:36:19.525982 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.525793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9" event={"ID":"92de5933-6ed2-4709-b1c0-b3d9cd7420d1","Type":"ContainerDied","Data":"adbc5009a4aab183638950a7d4d9f032d69340b98e18aef21e7dbcdc0b77f319"} Aug 05 19:36:19.525982 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.525818 2578 scope.go:117] "RemoveContainer" containerID="5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc" Aug 05 19:36:19.535640 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.535616 2578 scope.go:117] "RemoveContainer" containerID="5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc" Aug 05 19:36:19.535934 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:36:19.535913 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc\": container with ID starting with 5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc not found: ID does not exist" containerID="5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc" Aug 05 19:36:19.535991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.535945 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc"} err="failed to get container status \"5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc\": rpc error: code = NotFound desc = could not find container \"5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc\": container with ID starting with 5dd70ece5971b1d693174afa611135dab5354dc877a71131c8ad69b58f393dbc not found: ID does not exist" Aug 05 19:36:19.549804 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.549776 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9"] Aug 05 19:36:19.551735 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:19.551711 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-82a4c5b4-f5764c9bd-kb6q9"] Aug 05 19:36:20.538107 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:20.538064 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92de5933-6ed2-4709-b1c0-b3d9cd7420d1" path="/var/lib/kubelet/pods/92de5933-6ed2-4709-b1c0-b3d9cd7420d1/volumes" Aug 05 19:36:25.859637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:25.859596 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk"] Aug 05 19:36:25.860138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:25.859893 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" containerID="cri-o://86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7" gracePeriod=30 Aug 05 19:36:26.853305 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:26.853263 2578 patch_prober.go:28] interesting pod/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 19:36:26.853485 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:26.853325 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 19:36:31.127080 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.127012 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:36:31.201793 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.201729 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h66wv\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-kube-api-access-h66wv\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.201965 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.201806 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-credential-socket\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.201965 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.201828 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-data\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.201965 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.201862 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-certs\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.201965 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.201910 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-podinfo\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.201965 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.201944 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-token\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.202256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.201995 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2844ab4-a504-484e-9877-dcd2f0a064d1-istiod-ca-cert\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.202256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.202051 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-envoy\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.202256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.202112 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-socket\") pod \"e2844ab4-a504-484e-9877-dcd2f0a064d1\" (UID: \"e2844ab4-a504-484e-9877-dcd2f0a064d1\") " Aug 05 19:36:31.202256 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.202172 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:36:31.202468 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.202285 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:36:31.202468 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.202408 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.202468 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.202426 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.203043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.202652 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:36:31.203043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.202669 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:36:31.203043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.203002 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2844ab4-a504-484e-9877-dcd2f0a064d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:36:31.204299 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.204264 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-kube-api-access-h66wv" (OuterVolumeSpecName: "kube-api-access-h66wv") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "kube-api-access-h66wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:36:31.204566 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.204544 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:36:31.204709 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.204689 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:36:31.204779 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.204694 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2844ab4-a504-484e-9877-dcd2f0a064d1" (UID: "e2844ab4-a504-484e-9877-dcd2f0a064d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:36:31.303692 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.303645 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.303692 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.303681 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.303692 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.303691 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2844ab4-a504-484e-9877-dcd2f0a064d1-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.303692 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.303699 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.303692 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.303707 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.304039 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.303718 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h66wv\" (UniqueName: \"kubernetes.io/projected/e2844ab4-a504-484e-9877-dcd2f0a064d1-kube-api-access-h66wv\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.304039 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.303728 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2844ab4-a504-484e-9877-dcd2f0a064d1-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:36:31.589159 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.589117 2578 generic.go:356] "Generic (PLEG): container finished" podID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerID="86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7" exitCode=0 Aug 05 19:36:31.589159 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.589164 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" Aug 05 19:36:31.589392 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.589195 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" event={"ID":"e2844ab4-a504-484e-9877-dcd2f0a064d1","Type":"ContainerDied","Data":"86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7"} Aug 05 19:36:31.589392 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.589256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk" event={"ID":"e2844ab4-a504-484e-9877-dcd2f0a064d1","Type":"ContainerDied","Data":"ca0704882073ae05675817329b59bd4e4fe7340da2f46591de4223bf96e3fe27"} Aug 05 19:36:31.589392 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.589280 2578 scope.go:117] "RemoveContainer" containerID="86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7" Aug 05 19:36:31.599690 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.599670 2578 scope.go:117] "RemoveContainer" containerID="a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101" Aug 05 19:36:31.608641 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.608618 2578 scope.go:117] "RemoveContainer" containerID="86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7" Aug 05 19:36:31.608990 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:36:31.608968 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7\": container with ID starting with 86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7 not found: ID does not exist" containerID="86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7" Aug 05 19:36:31.609085 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.608996 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7"} err="failed to get container status \"86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7\": rpc error: code = NotFound desc = could not find container \"86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7\": container with ID starting with 86c928213c300e87374dc946f287b9e17303bf2c5f03b2ddd68bae36967cc2f7 not found: ID does not exist" Aug 05 19:36:31.609085 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.609016 2578 scope.go:117] "RemoveContainer" containerID="a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101" Aug 05 19:36:31.609262 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:36:31.609244 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101\": container with ID starting with a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101 not found: ID does not exist" containerID="a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101" Aug 05 19:36:31.609302 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.609267 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101"} err="failed to get container status \"a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101\": rpc error: code = NotFound desc = could not find container \"a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101\": container with ID starting with a3799e2a527b9b1a63d1f197e5a9a9e29e5942071e28b96e44dd1afbbe30e101 not found: ID does not exist" Aug 05 19:36:31.614106 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.614077 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk"] Aug 05 19:36:31.621098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:31.621073 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-82a4c5b4-openshift-default-7d6f7f964d-5tzjk"] Aug 05 19:36:32.538090 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:36:32.538053 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" path="/var/lib/kubelet/pods/e2844ab4-a504-484e-9877-dcd2f0a064d1/volumes" Aug 05 19:38:40.935903 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.935792 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9"] Aug 05 19:38:40.936403 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.936386 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" Aug 05 19:38:40.936450 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.936407 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" Aug 05 19:38:40.936450 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.936433 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92de5933-6ed2-4709-b1c0-b3d9cd7420d1" containerName="payload-pre-processing" Aug 05 19:38:40.936450 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.936442 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="92de5933-6ed2-4709-b1c0-b3d9cd7420d1" containerName="payload-pre-processing" Aug 05 19:38:40.936543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.936455 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" Aug 05 19:38:40.936543 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.936465 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" Aug 05 19:38:40.936609 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.936579 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" Aug 05 19:38:40.936609 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.936595 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="92de5933-6ed2-4709-b1c0-b3d9cd7420d1" containerName="payload-pre-processing" Aug 05 19:38:40.940145 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.940124 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:40.943013 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.942989 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b2d0ff34-openshift-default-dockercfg-s5278\"" Aug 05 19:38:40.955445 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:40.955416 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9"] Aug 05 19:38:41.040427 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gnhq\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-kube-api-access-9gnhq\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.040727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-credential-socket\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.040727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-envoy\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.040727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-certs\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.040727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-socket\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.040727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-data\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.041043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-token\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.041043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040785 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istiod-ca-cert\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.041043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.040882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-podinfo\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.141802 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.141768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-envoy\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.141802 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.141809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-certs\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142051 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.141847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-socket\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142051 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.141875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-data\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142051 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.141904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-token\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142051 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.141926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istiod-ca-cert\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142265 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.142054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-podinfo\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142265 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.142112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnhq\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-kube-api-access-9gnhq\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142265 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.142141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-credential-socket\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142428 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.142281 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-data\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142428 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.142350 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-socket\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.142540 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-credential-socket\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142667 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.142644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-certs\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.142740 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.142647 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istiod-ca-cert\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.144220 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.144197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-envoy\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.144651 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.144626 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-podinfo\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.150991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.150965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-token\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.151158 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.151139 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gnhq\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-kube-api-access-9gnhq\") pod \"e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.251052 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.250955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:41.411235 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.411207 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9"] Aug 05 19:38:41.414143 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:38:41.414112 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7cd3d98_27d9_422e_bb23_cbad54e434ba.slice/crio-4f29f7dba732cbaeb2856e814dc680a330fa3ec41e0dca7042d30807f5ce5c4f WatchSource:0}: Error finding container 4f29f7dba732cbaeb2856e814dc680a330fa3ec41e0dca7042d30807f5ce5c4f: Status 404 returned error can't find the container with id 4f29f7dba732cbaeb2856e814dc680a330fa3ec41e0dca7042d30807f5ce5c4f Aug 05 19:38:41.421179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.420928 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:38:41.421179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.421072 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:38:41.421179 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:41.421156 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:38:42.253599 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:42.253560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" event={"ID":"b7cd3d98-27d9-422e-bb23-cbad54e434ba","Type":"ContainerStarted","Data":"743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c"} Aug 05 19:38:42.253994 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:42.253625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" event={"ID":"b7cd3d98-27d9-422e-bb23-cbad54e434ba","Type":"ContainerStarted","Data":"4f29f7dba732cbaeb2856e814dc680a330fa3ec41e0dca7042d30807f5ce5c4f"} Aug 05 19:38:42.274398 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:42.274350 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" podStartSLOduration=2.274332155 podStartE2EDuration="2.274332155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:38:42.273117819 +0000 UTC m=+2248.293180867" watchObservedRunningTime="2026-08-05 19:38:42.274332155 +0000 UTC m=+2248.294395281" Aug 05 19:38:43.251910 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:43.251867 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:43.257521 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:43.257493 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:43.258363 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:43.258342 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:43.259033 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:43.259018 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:38:46.046535 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.046493 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55"] Aug 05 19:38:46.047200 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.047181 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2844ab4-a504-484e-9877-dcd2f0a064d1" containerName="istio-proxy" Aug 05 19:38:46.050534 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.050508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:46.053202 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.053177 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b2d0ff34-dockercfg-9vf4k\"" Aug 05 19:38:46.053365 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.053349 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b2d0ff34\"" Aug 05 19:38:46.064955 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.064920 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55"] Aug 05 19:38:46.088891 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.088848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df4tf\" (UniqueName: \"kubernetes.io/projected/f6a69539-422b-40d1-871f-70659dc6547c-kube-api-access-df4tf\") pod \"payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55\" (UID: \"f6a69539-422b-40d1-871f-70659dc6547c\") " pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:46.088891 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.088886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a69539-422b-40d1-871f-70659dc6547c-plugins-config-volume\") pod \"payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55\" (UID: \"f6a69539-422b-40d1-871f-70659dc6547c\") " pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:46.190185 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.190153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df4tf\" (UniqueName: \"kubernetes.io/projected/f6a69539-422b-40d1-871f-70659dc6547c-kube-api-access-df4tf\") pod \"payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55\" (UID: \"f6a69539-422b-40d1-871f-70659dc6547c\") " pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:46.190369 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.190189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a69539-422b-40d1-871f-70659dc6547c-plugins-config-volume\") pod \"payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55\" (UID: \"f6a69539-422b-40d1-871f-70659dc6547c\") " pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:46.191005 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.190983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a69539-422b-40d1-871f-70659dc6547c-plugins-config-volume\") pod \"payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55\" (UID: \"f6a69539-422b-40d1-871f-70659dc6547c\") " pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:46.198796 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.198768 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df4tf\" (UniqueName: \"kubernetes.io/projected/f6a69539-422b-40d1-871f-70659dc6547c-kube-api-access-df4tf\") pod \"payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55\" (UID: \"f6a69539-422b-40d1-871f-70659dc6547c\") " pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:46.362343 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.362298 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:46.541871 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:46.541844 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55"] Aug 05 19:38:47.283138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:47.283098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" event={"ID":"f6a69539-422b-40d1-871f-70659dc6547c","Type":"ContainerStarted","Data":"a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87"} Aug 05 19:38:47.283567 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:47.283168 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:47.283567 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:47.283192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" event={"ID":"f6a69539-422b-40d1-871f-70659dc6547c","Type":"ContainerStarted","Data":"eb0a06da4d97d721c1bdd8955dfe31ea3abea106ff099b1ccbfa870bb650b270"} Aug 05 19:38:47.301587 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:47.301528 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" podStartSLOduration=1.301511025 podStartE2EDuration="1.301511025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:38:47.300261919 +0000 UTC m=+2253.320324969" watchObservedRunningTime="2026-08-05 19:38:47.301511025 +0000 UTC m=+2253.321574119" Aug 05 19:38:58.291885 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:58.291846 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:38:59.300983 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:59.300939 2578 patch_prober.go:28] interesting pod/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Aug 05 19:38:59.303345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:38:59.301008 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Aug 05 19:39:00.356680 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:00.356645 2578 generic.go:356] "Generic (PLEG): container finished" podID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerID="743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c" exitCode=0 Aug 05 19:39:00.357160 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:00.356722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" event={"ID":"b7cd3d98-27d9-422e-bb23-cbad54e434ba","Type":"ContainerDied","Data":"743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c"} Aug 05 19:39:00.357245 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:00.357163 2578 scope.go:117] "RemoveContainer" containerID="743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c" Aug 05 19:39:00.358209 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:00.358179 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:39:00.358313 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:00.358265 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:39:00.358313 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:00.358300 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:39:01.364265 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:01.364228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" event={"ID":"b7cd3d98-27d9-422e-bb23-cbad54e434ba","Type":"ContainerStarted","Data":"b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60"} Aug 05 19:39:02.251980 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:02.251932 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:39:02.252248 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:02.252221 2578 patch_prober.go:28] interesting pod/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Aug 05 19:39:02.252312 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:02.252291 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Aug 05 19:39:03.251521 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:03.251477 2578 patch_prober.go:28] interesting pod/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Aug 05 19:39:03.251979 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:03.251538 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Aug 05 19:39:04.251495 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:04.251454 2578 patch_prober.go:28] interesting pod/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Aug 05 19:39:04.251716 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:04.251515 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Aug 05 19:39:05.251456 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:05.251409 2578 patch_prober.go:28] interesting pod/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Aug 05 19:39:05.251639 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:05.251479 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Aug 05 19:39:06.251720 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:06.251674 2578 patch_prober.go:28] interesting pod/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Aug 05 19:39:06.252154 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:06.251787 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Aug 05 19:39:07.255210 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:07.255177 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:39:07.255607 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:07.255521 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:39:07.256269 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:39:07.256248 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:40:03.895106 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:03.895065 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55"] Aug 05 19:40:03.895660 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:03.895277 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" podUID="f6a69539-422b-40d1-871f-70659dc6547c" containerName="payload-processing" containerID="cri-o://a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87" gracePeriod=30 Aug 05 19:40:04.169009 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.168979 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:40:04.246967 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.246932 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df4tf\" (UniqueName: \"kubernetes.io/projected/f6a69539-422b-40d1-871f-70659dc6547c-kube-api-access-df4tf\") pod \"f6a69539-422b-40d1-871f-70659dc6547c\" (UID: \"f6a69539-422b-40d1-871f-70659dc6547c\") " Aug 05 19:40:04.247142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.247011 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a69539-422b-40d1-871f-70659dc6547c-plugins-config-volume\") pod \"f6a69539-422b-40d1-871f-70659dc6547c\" (UID: \"f6a69539-422b-40d1-871f-70659dc6547c\") " Aug 05 19:40:04.247435 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.247412 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a69539-422b-40d1-871f-70659dc6547c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6a69539-422b-40d1-871f-70659dc6547c" (UID: "f6a69539-422b-40d1-871f-70659dc6547c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:40:04.249117 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.249093 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a69539-422b-40d1-871f-70659dc6547c-kube-api-access-df4tf" (OuterVolumeSpecName: "kube-api-access-df4tf") pod "f6a69539-422b-40d1-871f-70659dc6547c" (UID: "f6a69539-422b-40d1-871f-70659dc6547c"). InnerVolumeSpecName "kube-api-access-df4tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:40:04.347851 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.347815 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df4tf\" (UniqueName: \"kubernetes.io/projected/f6a69539-422b-40d1-871f-70659dc6547c-kube-api-access-df4tf\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:40:04.347851 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.347844 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a69539-422b-40d1-871f-70659dc6547c-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:40:04.698204 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.698166 2578 generic.go:356] "Generic (PLEG): container finished" podID="f6a69539-422b-40d1-871f-70659dc6547c" containerID="a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87" exitCode=0 Aug 05 19:40:04.698415 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.698217 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" Aug 05 19:40:04.698415 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.698237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" event={"ID":"f6a69539-422b-40d1-871f-70659dc6547c","Type":"ContainerDied","Data":"a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87"} Aug 05 19:40:04.698415 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.698289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55" event={"ID":"f6a69539-422b-40d1-871f-70659dc6547c","Type":"ContainerDied","Data":"eb0a06da4d97d721c1bdd8955dfe31ea3abea106ff099b1ccbfa870bb650b270"} Aug 05 19:40:04.698415 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.698318 2578 scope.go:117] "RemoveContainer" containerID="a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87" Aug 05 19:40:04.714427 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.714396 2578 scope.go:117] "RemoveContainer" containerID="a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87" Aug 05 19:40:04.714863 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:40:04.714839 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87\": container with ID starting with a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87 not found: ID does not exist" containerID="a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87" Aug 05 19:40:04.714941 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.714872 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87"} err="failed to get container status \"a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87\": rpc error: code = NotFound desc = could not find container \"a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87\": container with ID starting with a868e985c7071127517fe433cac7ad361a01700aaeffb8a652f205fe30db1a87 not found: ID does not exist" Aug 05 19:40:04.716566 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.716545 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55"] Aug 05 19:40:04.722250 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:04.722222 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b2d0ff34-5c96d56f8b-hns55"] Aug 05 19:40:06.538206 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:06.538117 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a69539-422b-40d1-871f-70659dc6547c" path="/var/lib/kubelet/pods/f6a69539-422b-40d1-871f-70659dc6547c/volumes" Aug 05 19:40:55.729007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:55.728966 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9"] Aug 05 19:40:55.729493 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:40:55.729203 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" containerID="cri-o://b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60" gracePeriod=30 Aug 05 19:41:00.994191 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:00.994155 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:41:00.997085 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:00.997013 2578 generic.go:356] "Generic (PLEG): container finished" podID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerID="b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60" exitCode=0 Aug 05 19:41:00.997085 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:00.997063 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" Aug 05 19:41:00.997237 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:00.997089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" event={"ID":"b7cd3d98-27d9-422e-bb23-cbad54e434ba","Type":"ContainerDied","Data":"b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60"} Aug 05 19:41:00.997237 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:00.997148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9" event={"ID":"b7cd3d98-27d9-422e-bb23-cbad54e434ba","Type":"ContainerDied","Data":"4f29f7dba732cbaeb2856e814dc680a330fa3ec41e0dca7042d30807f5ce5c4f"} Aug 05 19:41:00.997237 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:00.997173 2578 scope.go:117] "RemoveContainer" containerID="b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60" Aug 05 19:41:01.006029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.006004 2578 scope.go:117] "RemoveContainer" containerID="743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c" Aug 05 19:41:01.014981 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.014959 2578 scope.go:117] "RemoveContainer" containerID="b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60" Aug 05 19:41:01.015254 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:41:01.015229 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60\": container with ID starting with b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60 not found: ID does not exist" containerID="b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60" Aug 05 19:41:01.015345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.015259 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60"} err="failed to get container status \"b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60\": rpc error: code = NotFound desc = could not find container \"b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60\": container with ID starting with b5f43f7ce97a79eda263b731b31bfce8a95fba710a1a5a847261ce5cd6956b60 not found: ID does not exist" Aug 05 19:41:01.015345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.015289 2578 scope.go:117] "RemoveContainer" containerID="743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c" Aug 05 19:41:01.015550 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:41:01.015527 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c\": container with ID starting with 743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c not found: ID does not exist" containerID="743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c" Aug 05 19:41:01.015611 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.015562 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c"} err="failed to get container status \"743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c\": rpc error: code = NotFound desc = could not find container \"743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c\": container with ID starting with 743ff58ca608368b86a1323dc47eca41825116d6d84b09612effac845e33c99c not found: ID does not exist" Aug 05 19:41:01.089493 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089456 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istiod-ca-cert\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.089493 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089495 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-socket\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.089772 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089518 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-certs\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.089772 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089561 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-data\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.089772 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089585 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-credential-socket\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.089772 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089612 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-podinfo\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.089772 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089698 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-token\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.090133 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089815 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:41:01.090133 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089879 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:41:01.090133 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089913 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:41:01.090133 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089985 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:41:01.090133 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.089998 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gnhq\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-kube-api-access-9gnhq\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.090133 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.090055 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-envoy\") pod \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\" (UID: \"b7cd3d98-27d9-422e-bb23-cbad54e434ba\") " Aug 05 19:41:01.090457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.090398 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.090457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.090417 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.090457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.090430 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.090457 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.090443 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.090670 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.090475 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:41:01.092156 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.092125 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:41:01.092289 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.092156 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:41:01.092487 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.092459 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:41:01.092601 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.092526 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-kube-api-access-9gnhq" (OuterVolumeSpecName: "kube-api-access-9gnhq") pod "b7cd3d98-27d9-422e-bb23-cbad54e434ba" (UID: "b7cd3d98-27d9-422e-bb23-cbad54e434ba"). InnerVolumeSpecName "kube-api-access-9gnhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:41:01.191850 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.191808 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.191850 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.191842 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.191850 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.191852 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gnhq\" (UniqueName: \"kubernetes.io/projected/b7cd3d98-27d9-422e-bb23-cbad54e434ba-kube-api-access-9gnhq\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.191850 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.191862 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.192134 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.191872 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7cd3d98-27d9-422e-bb23-cbad54e434ba-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:41:01.320835 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.320796 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9"] Aug 05 19:41:01.322783 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:01.322739 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b2d0ff34-openshift-default-6b8c7cc6cb-gpmm9"] Aug 05 19:41:02.538141 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:02.538109 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" path="/var/lib/kubelet/pods/b7cd3d98-27d9-422e-bb23-cbad54e434ba/volumes" Aug 05 19:41:14.652070 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:14.652035 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:41:14.658862 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:41:14.658832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:42:00.618047 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618012 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5"] Aug 05 19:42:00.618501 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618446 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a69539-422b-40d1-871f-70659dc6547c" containerName="payload-processing" Aug 05 19:42:00.618501 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618461 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a69539-422b-40d1-871f-70659dc6547c" containerName="payload-processing" Aug 05 19:42:00.618501 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618490 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" Aug 05 19:42:00.618501 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618496 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" Aug 05 19:42:00.618634 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618509 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" Aug 05 19:42:00.618634 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618515 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" Aug 05 19:42:00.618634 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618580 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" Aug 05 19:42:00.618634 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618590 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7cd3d98-27d9-422e-bb23-cbad54e434ba" containerName="istio-proxy" Aug 05 19:42:00.618634 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.618599 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a69539-422b-40d1-871f-70659dc6547c" containerName="payload-processing" Aug 05 19:42:00.621829 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.621805 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.624686 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.624662 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8dc955-openshift-default-dockercfg-j6d5x\"" Aug 05 19:42:00.635464 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.635431 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5"] Aug 05 19:42:00.657075 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svdsk\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-kube-api-access-svdsk\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.657264 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-certs\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.657264 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b61499-5295-45d5-b7c0-7325aa7c107c-istiod-ca-cert\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.657264 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-envoy\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.657264 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-socket\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.657264 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-token\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.657526 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-credential-socket\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.657526 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-data\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.657526 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.657446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-podinfo\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.758913 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.758859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-envoy\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.758913 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.758918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-socket\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759194 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.758954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-token\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759194 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.758991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-credential-socket\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759194 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-data\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759194 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-podinfo\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759194 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svdsk\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-kube-api-access-svdsk\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759194 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-certs\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759194 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b61499-5295-45d5-b7c0-7325aa7c107c-istiod-ca-cert\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759442 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-data\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759477 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-socket\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759561 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759497 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-credential-socket\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759722 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759678 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-certs\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.759947 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.759927 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b61499-5295-45d5-b7c0-7325aa7c107c-istiod-ca-cert\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.761517 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.761495 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-envoy\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.761820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.761801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-podinfo\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.768056 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.768032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-token\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.768193 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.768125 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svdsk\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-kube-api-access-svdsk\") pod \"e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:00.933928 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:00.933836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:01.087289 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:01.087261 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5"] Aug 05 19:42:01.088851 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:42:01.088811 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b61499_5295_45d5_b7c0_7325aa7c107c.slice/crio-a19e1a721bea0787845d5a61f7aa2dd8d6d48cdab9bba7f1abf13b7d95b1bfec WatchSource:0}: Error finding container a19e1a721bea0787845d5a61f7aa2dd8d6d48cdab9bba7f1abf13b7d95b1bfec: Status 404 returned error can't find the container with id a19e1a721bea0787845d5a61f7aa2dd8d6d48cdab9bba7f1abf13b7d95b1bfec Aug 05 19:42:01.091112 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:01.091079 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:01.091215 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:01.091155 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:01.091215 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:01.091186 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:01.311299 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:01.311257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" event={"ID":"e1b61499-5295-45d5-b7c0-7325aa7c107c","Type":"ContainerStarted","Data":"7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a"} Aug 05 19:42:01.311517 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:01.311326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" event={"ID":"e1b61499-5295-45d5-b7c0-7325aa7c107c","Type":"ContainerStarted","Data":"a19e1a721bea0787845d5a61f7aa2dd8d6d48cdab9bba7f1abf13b7d95b1bfec"} Aug 05 19:42:01.334289 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:01.334221 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" podStartSLOduration=1.334193986 podStartE2EDuration="1.334193986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:42:01.331937489 +0000 UTC m=+2447.352000537" watchObservedRunningTime="2026-08-05 19:42:01.334193986 +0000 UTC m=+2447.354257035" Aug 05 19:42:01.933984 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:01.933947 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:02.940354 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:02.940316 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:03.323243 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:03.323201 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:03.324207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:03.324185 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:17.401146 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:17.401104 2578 generic.go:356] "Generic (PLEG): container finished" podID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerID="7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a" exitCode=0 Aug 05 19:42:17.401593 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:17.401177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" event={"ID":"e1b61499-5295-45d5-b7c0-7325aa7c107c","Type":"ContainerDied","Data":"7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a"} Aug 05 19:42:17.401636 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:17.401600 2578 scope.go:117] "RemoveContainer" containerID="7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a" Aug 05 19:42:17.402685 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:17.402655 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:17.402838 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:17.402775 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:17.402838 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:17.402831 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:18.323153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:18.323112 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:18.408506 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:18.408464 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" event={"ID":"e1b61499-5295-45d5-b7c0-7325aa7c107c","Type":"ContainerStarted","Data":"729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb"} Aug 05 19:42:18.935808 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:18.935738 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:18.936262 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:18.936239 2578 patch_prober.go:28] interesting pod/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Aug 05 19:42:18.936443 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:18.936418 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Aug 05 19:42:19.935345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:19.935297 2578 patch_prober.go:28] interesting pod/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Aug 05 19:42:19.936036 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:19.935994 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Aug 05 19:42:20.934642 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:20.934587 2578 patch_prober.go:28] interesting pod/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Aug 05 19:42:20.934904 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:20.934658 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Aug 05 19:42:21.934350 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:21.934297 2578 patch_prober.go:28] interesting pod/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Aug 05 19:42:21.934952 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:21.934376 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Aug 05 19:42:22.934594 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:22.934546 2578 patch_prober.go:28] interesting pod/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Aug 05 19:42:22.935168 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:22.934629 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Aug 05 19:42:23.939008 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:23.938976 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:23.939520 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:23.939361 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:23.940053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:23.940033 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:42:28.779449 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.779411 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v"] Aug 05 19:42:28.783235 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.783210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.785719 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.785685 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c87762-openshift-default-dockercfg-g85wn\"" Aug 05 19:42:28.797643 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.797615 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v"] Aug 05 19:42:28.847359 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a3cfae7-962b-4796-845d-4da2842de8aa-istiod-ca-cert\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.847359 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-socket\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.847571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-envoy\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.847571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-data\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.847571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-credential-socket\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.847571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-token\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.847571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-certs\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.847571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-podinfo\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.847782 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.847636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc74f\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-kube-api-access-cc74f\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.948999 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.948962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-data\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.948999 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-credential-socket\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-token\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-certs\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-podinfo\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc74f\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-kube-api-access-cc74f\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a3cfae7-962b-4796-845d-4da2842de8aa-istiod-ca-cert\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949565 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-socket\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949565 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949471 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-credential-socket\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949565 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949512 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-certs\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949565 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-envoy\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.949875 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.949852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-data\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.950035 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.950014 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a3cfae7-962b-4796-845d-4da2842de8aa-istiod-ca-cert\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.950098 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.950070 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-socket\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.951630 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.951597 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-podinfo\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.951818 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.951801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-envoy\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.957554 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.957527 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-token\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:28.957737 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:28.957718 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc74f\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-kube-api-access-cc74f\") pod \"e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:29.095016 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:29.094974 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:29.248483 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:29.248454 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v"] Aug 05 19:42:29.250918 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:42:29.250888 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3cfae7_962b_4796_845d_4da2842de8aa.slice/crio-ef46faa18fd7bb1d8b3e73144f7b71316e9eab41d18aa021373a2f7f8c203882 WatchSource:0}: Error finding container ef46faa18fd7bb1d8b3e73144f7b71316e9eab41d18aa021373a2f7f8c203882: Status 404 returned error can't find the container with id ef46faa18fd7bb1d8b3e73144f7b71316e9eab41d18aa021373a2f7f8c203882 Aug 05 19:42:29.253042 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:29.253013 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:29.253122 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:29.253080 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:29.253122 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:29.253107 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:29.478418 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:29.478307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" event={"ID":"5a3cfae7-962b-4796-845d-4da2842de8aa","Type":"ContainerStarted","Data":"60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57"} Aug 05 19:42:29.478418 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:29.478377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" event={"ID":"5a3cfae7-962b-4796-845d-4da2842de8aa","Type":"ContainerStarted","Data":"ef46faa18fd7bb1d8b3e73144f7b71316e9eab41d18aa021373a2f7f8c203882"} Aug 05 19:42:29.499614 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:29.499539 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" podStartSLOduration=1.499515768 podStartE2EDuration="1.499515768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:42:29.497999219 +0000 UTC m=+2475.518062267" watchObservedRunningTime="2026-08-05 19:42:29.499515768 +0000 UTC m=+2475.519578815" Aug 05 19:42:30.095878 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:30.095847 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:30.101239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:30.101211 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:30.483829 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:30.483725 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:30.484855 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:30.484837 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:33.174835 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.174805 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72"] Aug 05 19:42:33.178639 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.178621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:33.181762 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.181725 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c87762\"" Aug 05 19:42:33.181888 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.181828 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c87762-dockercfg-n22jn\"" Aug 05 19:42:33.190003 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.189981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24332ed4-d075-4055-a9d7-28530d4128e8-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72\" (UID: \"24332ed4-d075-4055-a9d7-28530d4128e8\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:33.190117 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.190041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98qjc\" (UniqueName: \"kubernetes.io/projected/24332ed4-d075-4055-a9d7-28530d4128e8-kube-api-access-98qjc\") pod \"payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72\" (UID: \"24332ed4-d075-4055-a9d7-28530d4128e8\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:33.192855 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.192832 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72"] Aug 05 19:42:33.291002 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.290959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24332ed4-d075-4055-a9d7-28530d4128e8-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72\" (UID: \"24332ed4-d075-4055-a9d7-28530d4128e8\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:33.291191 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.291027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98qjc\" (UniqueName: \"kubernetes.io/projected/24332ed4-d075-4055-a9d7-28530d4128e8-kube-api-access-98qjc\") pod \"payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72\" (UID: \"24332ed4-d075-4055-a9d7-28530d4128e8\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:33.291716 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.291696 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24332ed4-d075-4055-a9d7-28530d4128e8-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72\" (UID: \"24332ed4-d075-4055-a9d7-28530d4128e8\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:33.313207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.313177 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98qjc\" (UniqueName: \"kubernetes.io/projected/24332ed4-d075-4055-a9d7-28530d4128e8-kube-api-access-98qjc\") pod \"payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72\" (UID: \"24332ed4-d075-4055-a9d7-28530d4128e8\") " pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:33.490053 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.489963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:33.632876 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:33.632838 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72"] Aug 05 19:42:33.633689 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:42:33.633658 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24332ed4_d075_4055_a9d7_28530d4128e8.slice/crio-5829cf69d8f733644504568707935673bfeb939b901dc53d7510f0a3fe1a35cc WatchSource:0}: Error finding container 5829cf69d8f733644504568707935673bfeb939b901dc53d7510f0a3fe1a35cc: Status 404 returned error can't find the container with id 5829cf69d8f733644504568707935673bfeb939b901dc53d7510f0a3fe1a35cc Aug 05 19:42:34.506919 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:34.506883 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" event={"ID":"24332ed4-d075-4055-a9d7-28530d4128e8","Type":"ContainerStarted","Data":"4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67"} Aug 05 19:42:34.507407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:34.506939 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" event={"ID":"24332ed4-d075-4055-a9d7-28530d4128e8","Type":"ContainerStarted","Data":"5829cf69d8f733644504568707935673bfeb939b901dc53d7510f0a3fe1a35cc"} Aug 05 19:42:34.507407 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:34.506984 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:34.529557 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:34.529501 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" podStartSLOduration=1.529485009 podStartE2EDuration="1.529485009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:42:34.52761053 +0000 UTC m=+2480.547673578" watchObservedRunningTime="2026-08-05 19:42:34.529485009 +0000 UTC m=+2480.549548057" Aug 05 19:42:45.515593 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:45.515555 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:42:45.784063 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:45.783203 2578 patch_prober.go:28] interesting pod/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:34772->10.132.0.57:15021: read: connection reset by peer" start-of-body= Aug 05 19:42:45.784063 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:45.783272 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:34772->10.132.0.57:15021: read: connection reset by peer" Aug 05 19:42:46.586022 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:46.585987 2578 generic.go:356] "Generic (PLEG): container finished" podID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerID="60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57" exitCode=0 Aug 05 19:42:46.586417 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:46.586064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" event={"ID":"5a3cfae7-962b-4796-845d-4da2842de8aa","Type":"ContainerDied","Data":"60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57"} Aug 05 19:42:46.586553 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:46.586537 2578 scope.go:117] "RemoveContainer" containerID="60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57" Aug 05 19:42:46.587643 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:46.587616 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:46.587700 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:46.587686 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:46.587738 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:46.587717 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:42:47.594470 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:47.594431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" event={"ID":"5a3cfae7-962b-4796-845d-4da2842de8aa","Type":"ContainerStarted","Data":"af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1"} Aug 05 19:42:48.096126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:48.096085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:48.096380 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:48.096352 2578 patch_prober.go:28] interesting pod/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Aug 05 19:42:48.096468 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:48.096418 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Aug 05 19:42:49.095416 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:49.095375 2578 patch_prober.go:28] interesting pod/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Aug 05 19:42:49.095864 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:49.095435 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Aug 05 19:42:50.095872 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:50.095837 2578 patch_prober.go:28] interesting pod/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Aug 05 19:42:50.096293 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:50.095889 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Aug 05 19:42:51.095507 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:51.095464 2578 patch_prober.go:28] interesting pod/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Aug 05 19:42:51.095703 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:51.095529 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Aug 05 19:42:52.096242 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:52.096205 2578 patch_prober.go:28] interesting pod/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Aug 05 19:42:52.096641 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:52.096264 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Aug 05 19:42:53.099765 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:53.099717 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:53.100266 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:53.100252 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:42:53.100974 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:42:53.100954 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:44:28.877634 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:28.877597 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5"] Aug 05 19:44:28.878278 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:28.877906 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" containerID="cri-o://729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb" gracePeriod=30 Aug 05 19:44:34.145877 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.145794 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:44:34.174142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.174107 2578 generic.go:356] "Generic (PLEG): container finished" podID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerID="729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb" exitCode=0 Aug 05 19:44:34.174331 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.174166 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" Aug 05 19:44:34.174331 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.174193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" event={"ID":"e1b61499-5295-45d5-b7c0-7325aa7c107c","Type":"ContainerDied","Data":"729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb"} Aug 05 19:44:34.174331 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.174263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5" event={"ID":"e1b61499-5295-45d5-b7c0-7325aa7c107c","Type":"ContainerDied","Data":"a19e1a721bea0787845d5a61f7aa2dd8d6d48cdab9bba7f1abf13b7d95b1bfec"} Aug 05 19:44:34.174331 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.174295 2578 scope.go:117] "RemoveContainer" containerID="729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb" Aug 05 19:44:34.185391 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.185364 2578 scope.go:117] "RemoveContainer" containerID="7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a" Aug 05 19:44:34.194379 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.194357 2578 scope.go:117] "RemoveContainer" containerID="729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb" Aug 05 19:44:34.194723 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:44:34.194701 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb\": container with ID starting with 729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb not found: ID does not exist" containerID="729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb" Aug 05 19:44:34.194806 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.194735 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb"} err="failed to get container status \"729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb\": rpc error: code = NotFound desc = could not find container \"729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb\": container with ID starting with 729d60d3e6642919d3e252e326963676efdb0b28f0eab12a0df602f293e904bb not found: ID does not exist" Aug 05 19:44:34.194806 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.194774 2578 scope.go:117] "RemoveContainer" containerID="7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a" Aug 05 19:44:34.195107 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:44:34.195086 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a\": container with ID starting with 7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a not found: ID does not exist" containerID="7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a" Aug 05 19:44:34.195183 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.195118 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a"} err="failed to get container status \"7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a\": rpc error: code = NotFound desc = could not find container \"7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a\": container with ID starting with 7bef1ebd2cd3d1e3daf9272781cfc4502fcd08ac5fc7c3ae4c0fd070d1a6204a not found: ID does not exist" Aug 05 19:44:34.211470 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211436 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-credential-socket\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.211633 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211522 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-podinfo\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.211633 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211559 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svdsk\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-kube-api-access-svdsk\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.211633 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211598 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-token\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.211633 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211623 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-data\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.211865 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211673 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b61499-5295-45d5-b7c0-7325aa7c107c-istiod-ca-cert\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.211865 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211725 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:34.211865 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211784 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-envoy\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.211865 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211823 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-certs\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.211865 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.211855 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-socket\") pod \"e1b61499-5295-45d5-b7c0-7325aa7c107c\" (UID: \"e1b61499-5295-45d5-b7c0-7325aa7c107c\") " Aug 05 19:44:34.212108 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.212000 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:34.212108 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.212094 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1b61499-5295-45d5-b7c0-7325aa7c107c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:44:34.212253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.212231 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:34.212311 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.212294 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.212359 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.212317 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.212359 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.212332 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1b61499-5295-45d5-b7c0-7325aa7c107c-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.212433 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.212373 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:34.213942 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.213919 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:34.213942 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.213933 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:44:34.214234 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.214216 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-kube-api-access-svdsk" (OuterVolumeSpecName: "kube-api-access-svdsk") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "kube-api-access-svdsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:44:34.214304 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.214222 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1b61499-5295-45d5-b7c0-7325aa7c107c" (UID: "e1b61499-5295-45d5-b7c0-7325aa7c107c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:44:34.313130 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.313092 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.313130 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.313128 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svdsk\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-kube-api-access-svdsk\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.313130 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.313140 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.313373 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.313150 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.313373 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.313158 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.313373 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.313169 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1b61499-5295-45d5-b7c0-7325aa7c107c-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:34.497580 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.497541 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5"] Aug 05 19:44:34.503419 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.503386 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8dc955-openshift-default-5ffd94848b-rs5c5"] Aug 05 19:44:34.539350 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:34.539306 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" path="/var/lib/kubelet/pods/e1b61499-5295-45d5-b7c0-7325aa7c107c/volumes" Aug 05 19:44:39.884597 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:39.884501 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72"] Aug 05 19:44:39.885080 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:39.884768 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" podUID="24332ed4-d075-4055-a9d7-28530d4128e8" containerName="payload-processing" containerID="cri-o://4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67" gracePeriod=30 Aug 05 19:44:40.150936 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.150859 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:44:40.206176 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.206145 2578 generic.go:356] "Generic (PLEG): container finished" podID="24332ed4-d075-4055-a9d7-28530d4128e8" containerID="4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67" exitCode=0 Aug 05 19:44:40.206351 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.206193 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" Aug 05 19:44:40.206351 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.206204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" event={"ID":"24332ed4-d075-4055-a9d7-28530d4128e8","Type":"ContainerDied","Data":"4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67"} Aug 05 19:44:40.206351 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.206246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72" event={"ID":"24332ed4-d075-4055-a9d7-28530d4128e8","Type":"ContainerDied","Data":"5829cf69d8f733644504568707935673bfeb939b901dc53d7510f0a3fe1a35cc"} Aug 05 19:44:40.206351 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.206268 2578 scope.go:117] "RemoveContainer" containerID="4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67" Aug 05 19:44:40.215101 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.215082 2578 scope.go:117] "RemoveContainer" containerID="4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67" Aug 05 19:44:40.215380 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:44:40.215360 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67\": container with ID starting with 4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67 not found: ID does not exist" containerID="4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67" Aug 05 19:44:40.215436 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.215395 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67"} err="failed to get container status \"4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67\": rpc error: code = NotFound desc = could not find container \"4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67\": container with ID starting with 4d20d7568df7af740d8523a58a618d4dc5ecf296ec458c0f784bc30d6fda4b67 not found: ID does not exist" Aug 05 19:44:40.273083 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.273042 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98qjc\" (UniqueName: \"kubernetes.io/projected/24332ed4-d075-4055-a9d7-28530d4128e8-kube-api-access-98qjc\") pod \"24332ed4-d075-4055-a9d7-28530d4128e8\" (UID: \"24332ed4-d075-4055-a9d7-28530d4128e8\") " Aug 05 19:44:40.273257 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.273104 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24332ed4-d075-4055-a9d7-28530d4128e8-plugins-config-volume\") pod \"24332ed4-d075-4055-a9d7-28530d4128e8\" (UID: \"24332ed4-d075-4055-a9d7-28530d4128e8\") " Aug 05 19:44:40.273528 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.273501 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24332ed4-d075-4055-a9d7-28530d4128e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24332ed4-d075-4055-a9d7-28530d4128e8" (UID: "24332ed4-d075-4055-a9d7-28530d4128e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:44:40.275245 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.275221 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24332ed4-d075-4055-a9d7-28530d4128e8-kube-api-access-98qjc" (OuterVolumeSpecName: "kube-api-access-98qjc") pod "24332ed4-d075-4055-a9d7-28530d4128e8" (UID: "24332ed4-d075-4055-a9d7-28530d4128e8"). InnerVolumeSpecName "kube-api-access-98qjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:44:40.374647 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.374607 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98qjc\" (UniqueName: \"kubernetes.io/projected/24332ed4-d075-4055-a9d7-28530d4128e8-kube-api-access-98qjc\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:40.374647 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.374639 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24332ed4-d075-4055-a9d7-28530d4128e8-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:40.529469 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.529435 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72"] Aug 05 19:44:40.531411 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.531387 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-c87762-7d78c95758-7wg72"] Aug 05 19:44:40.539665 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:40.539634 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24332ed4-d075-4055-a9d7-28530d4128e8" path="/var/lib/kubelet/pods/24332ed4-d075-4055-a9d7-28530d4128e8/volumes" Aug 05 19:44:46.508144 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:46.508105 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v"] Aug 05 19:44:46.508545 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:46.508316 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" containerID="cri-o://af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1" gracePeriod=30 Aug 05 19:44:47.368959 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.368925 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm"] Aug 05 19:44:47.369348 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.369334 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" Aug 05 19:44:47.369348 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.369349 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" Aug 05 19:44:47.369447 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.369360 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24332ed4-d075-4055-a9d7-28530d4128e8" containerName="payload-processing" Aug 05 19:44:47.369447 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.369367 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="24332ed4-d075-4055-a9d7-28530d4128e8" containerName="payload-processing" Aug 05 19:44:47.369447 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.369440 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" Aug 05 19:44:47.369447 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.369448 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" Aug 05 19:44:47.369581 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.369454 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="24332ed4-d075-4055-a9d7-28530d4128e8" containerName="payload-processing" Aug 05 19:44:47.374014 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.373992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.376979 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.376962 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-94093f-openshift-default-dockercfg-ggjcm\"" Aug 05 19:44:47.389653 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.389621 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm"] Aug 05 19:44:47.540576 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istiod-ca-cert\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.541007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-envoy\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.541007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-podinfo\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.541007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-token\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.541007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-credential-socket\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.541007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-socket\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.541007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-certs\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.541007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwkqs\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-kube-api-access-bwkqs\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.541007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.540898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-data\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.641673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-token\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.641673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-credential-socket\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.641673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-socket\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642012 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-certs\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642012 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwkqs\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-kube-api-access-bwkqs\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642012 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-data\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642012 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istiod-ca-cert\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642012 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-envoy\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642012 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.641882 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-podinfo\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642306 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.642235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-certs\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642306 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.642257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-socket\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642391 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.642332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-credential-socket\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642391 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.642380 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-data\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.642637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.642618 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istiod-ca-cert\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.644269 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.644250 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-envoy\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.644484 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.644466 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-podinfo\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.649711 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.649687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-token\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.650015 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.649999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwkqs\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-kube-api-access-bwkqs\") pod \"e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.687761 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.687721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:47.838999 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.838970 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm"] Aug 05 19:44:47.841095 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:44:47.841059 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62072b24_a758_4b9e_9438_33ebe8b2ef3e.slice/crio-580e5e38c5e5db7c41598881c428eabb12e9ea946b024f75f26a7c938ca4fcb2 WatchSource:0}: Error finding container 580e5e38c5e5db7c41598881c428eabb12e9ea946b024f75f26a7c938ca4fcb2: Status 404 returned error can't find the container with id 580e5e38c5e5db7c41598881c428eabb12e9ea946b024f75f26a7c938ca4fcb2 Aug 05 19:44:47.843517 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.843475 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:44:47.843602 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.843567 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:44:47.843654 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:47.843609 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:44:48.251271 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:48.251176 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" event={"ID":"62072b24-a758-4b9e-9438-33ebe8b2ef3e","Type":"ContainerStarted","Data":"e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797"} Aug 05 19:44:48.251271 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:48.251258 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" event={"ID":"62072b24-a758-4b9e-9438-33ebe8b2ef3e","Type":"ContainerStarted","Data":"580e5e38c5e5db7c41598881c428eabb12e9ea946b024f75f26a7c938ca4fcb2"} Aug 05 19:44:48.274219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:48.274164 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podStartSLOduration=1.274148243 podStartE2EDuration="1.274148243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:44:48.272264261 +0000 UTC m=+2614.292327312" watchObservedRunningTime="2026-08-05 19:44:48.274148243 +0000 UTC m=+2614.294211290" Aug 05 19:44:48.687929 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:48.687889 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:48.693224 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:48.693198 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:49.257237 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:49.257207 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:49.258341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:49.258316 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:44:51.779827 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.779741 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:44:51.885935 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.885900 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a3cfae7-962b-4796-845d-4da2842de8aa-istiod-ca-cert\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.885948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-token\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.885998 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-data\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886046 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-socket\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886245 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886110 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-envoy\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886245 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886163 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc74f\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-kube-api-access-cc74f\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886245 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886204 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-credential-socket\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886245 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886226 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-certs\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886449 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886272 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-podinfo\") pod \"5a3cfae7-962b-4796-845d-4da2842de8aa\" (UID: \"5a3cfae7-962b-4796-845d-4da2842de8aa\") " Aug 05 19:44:51.886515 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886351 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a3cfae7-962b-4796-845d-4da2842de8aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:44:51.886515 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886481 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:51.886515 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886501 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:51.886689 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886578 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:51.886689 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886679 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:51.886841 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886699 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:51.886841 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886718 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:51.886841 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886731 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a3cfae7-962b-4796-845d-4da2842de8aa-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:51.886841 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.886739 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:51.888431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.888403 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:44:51.888557 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.888441 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:44:51.888557 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.888494 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:44:51.888557 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.888494 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-kube-api-access-cc74f" (OuterVolumeSpecName: "kube-api-access-cc74f") pod "5a3cfae7-962b-4796-845d-4da2842de8aa" (UID: "5a3cfae7-962b-4796-845d-4da2842de8aa"). InnerVolumeSpecName "kube-api-access-cc74f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:44:51.988342 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.988300 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:51.988342 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.988343 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:51.988594 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.988358 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc74f\" (UniqueName: \"kubernetes.io/projected/5a3cfae7-962b-4796-845d-4da2842de8aa-kube-api-access-cc74f\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:51.988594 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.988372 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a3cfae7-962b-4796-845d-4da2842de8aa-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:51.988594 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:51.988385 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a3cfae7-962b-4796-845d-4da2842de8aa-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:44:52.276149 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.276108 2578 generic.go:356] "Generic (PLEG): container finished" podID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerID="af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1" exitCode=0 Aug 05 19:44:52.276360 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.276156 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" Aug 05 19:44:52.276360 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.276193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" event={"ID":"5a3cfae7-962b-4796-845d-4da2842de8aa","Type":"ContainerDied","Data":"af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1"} Aug 05 19:44:52.276360 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.276253 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v" event={"ID":"5a3cfae7-962b-4796-845d-4da2842de8aa","Type":"ContainerDied","Data":"ef46faa18fd7bb1d8b3e73144f7b71316e9eab41d18aa021373a2f7f8c203882"} Aug 05 19:44:52.276360 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.276278 2578 scope.go:117] "RemoveContainer" containerID="af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1" Aug 05 19:44:52.288244 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.286941 2578 scope.go:117] "RemoveContainer" containerID="60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57" Aug 05 19:44:52.298274 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.298245 2578 scope.go:117] "RemoveContainer" containerID="af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1" Aug 05 19:44:52.298575 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:44:52.298555 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1\": container with ID starting with af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1 not found: ID does not exist" containerID="af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1" Aug 05 19:44:52.298648 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.298584 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1"} err="failed to get container status \"af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1\": rpc error: code = NotFound desc = could not find container \"af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1\": container with ID starting with af95be33fdb06f43baea2e8db247730409293281b720fced51d6164ff7fbafe1 not found: ID does not exist" Aug 05 19:44:52.298648 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.298602 2578 scope.go:117] "RemoveContainer" containerID="60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57" Aug 05 19:44:52.298884 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:44:52.298852 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57\": container with ID starting with 60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57 not found: ID does not exist" containerID="60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57" Aug 05 19:44:52.298947 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.298890 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57"} err="failed to get container status \"60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57\": rpc error: code = NotFound desc = could not find container \"60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57\": container with ID starting with 60e20a66e2fb610e11c635df98b91f231bd32d37c880414f66706f54fcd19a57 not found: ID does not exist" Aug 05 19:44:52.299146 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.299126 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v"] Aug 05 19:44:52.302111 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.302089 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c87762-openshift-default-5bf8c57f86-5mk7v"] Aug 05 19:44:52.538973 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:44:52.538876 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" path="/var/lib/kubelet/pods/5a3cfae7-962b-4796-845d-4da2842de8aa/volumes" Aug 05 19:45:04.259495 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:04.259389 2578 patch_prober.go:28] interesting pod/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Aug 05 19:45:04.259495 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:04.259465 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Aug 05 19:45:04.341383 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:04.341349 2578 generic.go:356] "Generic (PLEG): container finished" podID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerID="e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797" exitCode=0 Aug 05 19:45:04.341551 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:04.341424 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" event={"ID":"62072b24-a758-4b9e-9438-33ebe8b2ef3e","Type":"ContainerDied","Data":"e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797"} Aug 05 19:45:04.341933 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:04.341917 2578 scope.go:117] "RemoveContainer" containerID="e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797" Aug 05 19:45:04.343013 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:04.342981 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:04.343158 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:04.343089 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:04.343158 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:04.343123 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:05.353163 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:05.353123 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" event={"ID":"62072b24-a758-4b9e-9438-33ebe8b2ef3e","Type":"ContainerStarted","Data":"dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490"} Aug 05 19:45:05.687957 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:05.687866 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:45:05.688115 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:05.688081 2578 patch_prober.go:28] interesting pod/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Aug 05 19:45:05.688161 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:05.688128 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Aug 05 19:45:06.688141 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:06.688102 2578 patch_prober.go:28] interesting pod/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Aug 05 19:45:06.688533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:06.688157 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Aug 05 19:45:07.688283 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:07.688235 2578 patch_prober.go:28] interesting pod/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Aug 05 19:45:07.688677 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:07.688320 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Aug 05 19:45:08.688567 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:08.688526 2578 patch_prober.go:28] interesting pod/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Aug 05 19:45:08.689005 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:08.688590 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Aug 05 19:45:09.688394 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:09.688357 2578 patch_prober.go:28] interesting pod/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Aug 05 19:45:09.688583 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:09.688418 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Aug 05 19:45:10.692818 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:10.692783 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:45:10.693282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:10.693264 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:45:10.694136 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:10.694110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:45:15.843302 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.843262 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk"] Aug 05 19:45:15.843960 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.843940 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" Aug 05 19:45:15.844030 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.843963 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" Aug 05 19:45:15.844030 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.844004 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" Aug 05 19:45:15.844030 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.844014 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b61499-5295-45d5-b7c0-7325aa7c107c" containerName="istio-proxy" Aug 05 19:45:15.844030 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.844024 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" Aug 05 19:45:15.844280 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.844032 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" Aug 05 19:45:15.844280 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.844130 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" Aug 05 19:45:15.844280 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.844144 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3cfae7-962b-4796-845d-4da2842de8aa" containerName="istio-proxy" Aug 05 19:45:15.848986 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.848965 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.851952 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.851933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a47f42-openshift-default-dockercfg-fskhg\"" Aug 05 19:45:15.859394 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.859367 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk"] Aug 05 19:45:15.936296 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-data\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.936532 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-envoy\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.936532 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-certs\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.936532 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-istio-token\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.936532 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llgll\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-kube-api-access-llgll\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.936789 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00d98863-d3f3-45ea-8486-729f11e2944a-istio-podinfo\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.936789 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00d98863-d3f3-45ea-8486-729f11e2944a-istiod-ca-cert\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.936789 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-credential-socket\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:15.936789 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:15.936718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-socket\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.037920 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.037884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-data\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038120 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.037954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-envoy\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038120 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.037981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-certs\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038120 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-istio-token\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038120 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llgll\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-kube-api-access-llgll\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038344 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00d98863-d3f3-45ea-8486-729f11e2944a-istio-podinfo\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038344 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00d98863-d3f3-45ea-8486-729f11e2944a-istiod-ca-cert\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038344 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-credential-socket\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038344 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-socket\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038341 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-data\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-certs\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038685 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038610 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-socket\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.038780 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.038738 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-credential-socket\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.039017 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.039000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00d98863-d3f3-45ea-8486-729f11e2944a-istiod-ca-cert\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.040740 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.040717 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00d98863-d3f3-45ea-8486-729f11e2944a-istio-podinfo\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.040833 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.040801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-envoy\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.046452 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.046424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-istio-token\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.046966 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.046951 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llgll\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-kube-api-access-llgll\") pod \"e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.161112 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.161023 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:16.315954 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.315926 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk"] Aug 05 19:45:16.318104 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:45:16.318076 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d98863_d3f3_45ea_8486_729f11e2944a.slice/crio-82b0b67abd097da19cacab19bd4c38c35b7433975d8cf28cba72e2d8bd656da5 WatchSource:0}: Error finding container 82b0b67abd097da19cacab19bd4c38c35b7433975d8cf28cba72e2d8bd656da5: Status 404 returned error can't find the container with id 82b0b67abd097da19cacab19bd4c38c35b7433975d8cf28cba72e2d8bd656da5 Aug 05 19:45:16.320486 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.320451 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:16.320612 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.320535 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:16.320612 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.320579 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:16.415664 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.415574 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" event={"ID":"00d98863-d3f3-45ea-8486-729f11e2944a","Type":"ContainerStarted","Data":"55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971"} Aug 05 19:45:16.415664 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.415655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" event={"ID":"00d98863-d3f3-45ea-8486-729f11e2944a","Type":"ContainerStarted","Data":"82b0b67abd097da19cacab19bd4c38c35b7433975d8cf28cba72e2d8bd656da5"} Aug 05 19:45:16.439736 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:16.439669 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" podStartSLOduration=1.4396462589999999 podStartE2EDuration="1.439646259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:45:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:45:16.437331583 +0000 UTC m=+2642.457394630" watchObservedRunningTime="2026-08-05 19:45:16.439646259 +0000 UTC m=+2642.459709317" Aug 05 19:45:17.161919 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:17.161878 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:17.168119 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:17.168085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:17.420717 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:17.420620 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:17.421667 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:17.421647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:20.103728 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.103691 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc"] Aug 05 19:45:20.107668 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.107641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:20.110094 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.110070 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a47f42-dockercfg-qtr2m\"" Aug 05 19:45:20.110226 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.110100 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a47f42\"" Aug 05 19:45:20.114559 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.114497 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc"] Aug 05 19:45:20.180829 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.180740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk26h\" (UniqueName: \"kubernetes.io/projected/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-kube-api-access-sk26h\") pod \"payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc\" (UID: \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:20.181029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.180864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc\" (UID: \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:20.281512 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.281469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc\" (UID: \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:20.281689 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.281636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk26h\" (UniqueName: \"kubernetes.io/projected/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-kube-api-access-sk26h\") pod \"payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc\" (UID: \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:20.282225 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.282205 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc\" (UID: \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:20.289563 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.289526 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk26h\" (UniqueName: \"kubernetes.io/projected/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-kube-api-access-sk26h\") pod \"payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc\" (UID: \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:20.422110 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.422008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:20.573368 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:20.573337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc"] Aug 05 19:45:20.575094 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:45:20.575057 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8caa9421_e18b_4dd9_9b39_1115c8bf4b72.slice/crio-625f64e24766494293da65023a579bdace0876d60bd45dbcdd301aa700b77687 WatchSource:0}: Error finding container 625f64e24766494293da65023a579bdace0876d60bd45dbcdd301aa700b77687: Status 404 returned error can't find the container with id 625f64e24766494293da65023a579bdace0876d60bd45dbcdd301aa700b77687 Aug 05 19:45:21.446909 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:21.446860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" event={"ID":"8caa9421-e18b-4dd9-9b39-1115c8bf4b72","Type":"ContainerStarted","Data":"138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37"} Aug 05 19:45:21.447352 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:21.446941 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:21.447352 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:21.446967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" event={"ID":"8caa9421-e18b-4dd9-9b39-1115c8bf4b72","Type":"ContainerStarted","Data":"625f64e24766494293da65023a579bdace0876d60bd45dbcdd301aa700b77687"} Aug 05 19:45:21.464385 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:21.464323 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" podStartSLOduration=1.464304107 podStartE2EDuration="1.464304107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:45:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:45:21.462907784 +0000 UTC m=+2647.482970833" watchObservedRunningTime="2026-08-05 19:45:21.464304107 +0000 UTC m=+2647.484367154" Aug 05 19:45:32.454313 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:32.454279 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:45:54.625231 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:54.625194 2578 generic.go:356] "Generic (PLEG): container finished" podID="00d98863-d3f3-45ea-8486-729f11e2944a" containerID="55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971" exitCode=0 Aug 05 19:45:54.625674 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:54.625265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" event={"ID":"00d98863-d3f3-45ea-8486-729f11e2944a","Type":"ContainerDied","Data":"55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971"} Aug 05 19:45:54.625743 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:54.625732 2578 scope.go:117] "RemoveContainer" containerID="55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971" Aug 05 19:45:54.626877 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:54.626838 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:54.626955 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:54.626941 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:54.626991 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:54.626976 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:45:55.647078 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:55.646956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" event={"ID":"00d98863-d3f3-45ea-8486-729f11e2944a","Type":"ContainerStarted","Data":"8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a"} Aug 05 19:45:56.162158 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:56.162122 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:45:56.162431 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:56.162403 2578 patch_prober.go:28] interesting pod/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Aug 05 19:45:56.162524 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:56.162469 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Aug 05 19:45:57.161546 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:57.161504 2578 patch_prober.go:28] interesting pod/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Aug 05 19:45:57.162006 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:57.161566 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Aug 05 19:45:58.161673 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:58.161633 2578 patch_prober.go:28] interesting pod/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Aug 05 19:45:58.162103 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:58.161702 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Aug 05 19:45:59.161709 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:59.161675 2578 patch_prober.go:28] interesting pod/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Aug 05 19:45:59.162161 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:45:59.161735 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Aug 05 19:46:00.162310 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:00.162269 2578 patch_prober.go:28] interesting pod/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Aug 05 19:46:00.162734 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:00.162334 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Aug 05 19:46:01.165982 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:01.165949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:46:01.166381 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:01.166274 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:46:01.167145 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:01.167123 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:46:07.996507 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:07.996421 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm"] Aug 05 19:46:07.997080 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:07.996771 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" containerID="cri-o://dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490" gracePeriod=30 Aug 05 19:46:10.695903 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:10.695854 2578 patch_prober.go:28] interesting pod/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 19:46:10.696288 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:10.695949 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 19:46:13.259412 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.259343 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:46:13.422052 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422012 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-token\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422235 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422065 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istiod-ca-cert\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422235 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422092 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-certs\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422235 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422111 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-data\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422235 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422173 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwkqs\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-kube-api-access-bwkqs\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422454 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422247 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-envoy\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422454 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422277 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-credential-socket\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422454 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422324 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-socket\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422454 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422358 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-podinfo\") pod \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\" (UID: \"62072b24-a758-4b9e-9438-33ebe8b2ef3e\") " Aug 05 19:46:13.422683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422478 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-data" (OuterVolumeSpecName: "istio-data") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:13.422683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422491 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:13.422683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422524 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:46:13.422683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422665 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:13.422953 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422726 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:13.422953 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422854 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.422953 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422882 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.422953 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422897 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.422953 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422910 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.422953 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.422924 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.424409 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.424378 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:13.424517 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.424453 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-kube-api-access-bwkqs" (OuterVolumeSpecName: "kube-api-access-bwkqs") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "kube-api-access-bwkqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:46:13.424517 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.424487 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-token" (OuterVolumeSpecName: "istio-token") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:46:13.424589 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.424523 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62072b24-a758-4b9e-9438-33ebe8b2ef3e" (UID: "62072b24-a758-4b9e-9438-33ebe8b2ef3e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:46:13.524513 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.524421 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.524513 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.524457 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwkqs\" (UniqueName: \"kubernetes.io/projected/62072b24-a758-4b9e-9438-33ebe8b2ef3e-kube-api-access-bwkqs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.524513 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.524470 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.524513 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.524479 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62072b24-a758-4b9e-9438-33ebe8b2ef3e-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:13.758025 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.757984 2578 generic.go:356] "Generic (PLEG): container finished" podID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerID="dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490" exitCode=0 Aug 05 19:46:13.758211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.758041 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" Aug 05 19:46:13.758211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.758072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" event={"ID":"62072b24-a758-4b9e-9438-33ebe8b2ef3e","Type":"ContainerDied","Data":"dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490"} Aug 05 19:46:13.758211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.758148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm" event={"ID":"62072b24-a758-4b9e-9438-33ebe8b2ef3e","Type":"ContainerDied","Data":"580e5e38c5e5db7c41598881c428eabb12e9ea946b024f75f26a7c938ca4fcb2"} Aug 05 19:46:13.758211 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.758170 2578 scope.go:117] "RemoveContainer" containerID="dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490" Aug 05 19:46:13.769042 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.769019 2578 scope.go:117] "RemoveContainer" containerID="e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797" Aug 05 19:46:13.777713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.777693 2578 scope.go:117] "RemoveContainer" containerID="dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490" Aug 05 19:46:13.778023 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:46:13.778004 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490\": container with ID starting with dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490 not found: ID does not exist" containerID="dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490" Aug 05 19:46:13.778089 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.778030 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490"} err="failed to get container status \"dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490\": rpc error: code = NotFound desc = could not find container \"dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490\": container with ID starting with dc8429670a8a952f1ffd2aa2ae5a80f18b53d340c9503dd01ca1680084129490 not found: ID does not exist" Aug 05 19:46:13.778089 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.778048 2578 scope.go:117] "RemoveContainer" containerID="e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797" Aug 05 19:46:13.778264 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:46:13.778242 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797\": container with ID starting with e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797 not found: ID does not exist" containerID="e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797" Aug 05 19:46:13.778323 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.778275 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797"} err="failed to get container status \"e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797\": rpc error: code = NotFound desc = could not find container \"e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797\": container with ID starting with e7f47782093a25c87a52c23f2229764937c990dfba0a067b115a71198c15b797 not found: ID does not exist" Aug 05 19:46:13.781720 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.781692 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm"] Aug 05 19:46:13.786135 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:13.786111 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-94093f-openshift-default-6fdd6584b6-xmttm"] Aug 05 19:46:14.538585 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:14.538552 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" path="/var/lib/kubelet/pods/62072b24-a758-4b9e-9438-33ebe8b2ef3e/volumes" Aug 05 19:46:14.685968 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:14.685939 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:46:14.693862 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:14.693835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:46:23.823337 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:23.823301 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc"] Aug 05 19:46:23.823856 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:23.823572 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" podUID="8caa9421-e18b-4dd9-9b39-1115c8bf4b72" containerName="payload-pre-processing" containerID="cri-o://138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37" gracePeriod=30 Aug 05 19:46:24.094046 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.094019 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:46:24.120546 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.120512 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-plugins-config-volume\") pod \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\" (UID: \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\") " Aug 05 19:46:24.120730 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.120556 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk26h\" (UniqueName: \"kubernetes.io/projected/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-kube-api-access-sk26h\") pod \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\" (UID: \"8caa9421-e18b-4dd9-9b39-1115c8bf4b72\") " Aug 05 19:46:24.120939 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.120916 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8caa9421-e18b-4dd9-9b39-1115c8bf4b72" (UID: "8caa9421-e18b-4dd9-9b39-1115c8bf4b72"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:46:24.122877 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.122837 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-kube-api-access-sk26h" (OuterVolumeSpecName: "kube-api-access-sk26h") pod "8caa9421-e18b-4dd9-9b39-1115c8bf4b72" (UID: "8caa9421-e18b-4dd9-9b39-1115c8bf4b72"). InnerVolumeSpecName "kube-api-access-sk26h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:46:24.221312 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.221254 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:24.221312 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.221308 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk26h\" (UniqueName: \"kubernetes.io/projected/8caa9421-e18b-4dd9-9b39-1115c8bf4b72-kube-api-access-sk26h\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:24.816232 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.816196 2578 generic.go:356] "Generic (PLEG): container finished" podID="8caa9421-e18b-4dd9-9b39-1115c8bf4b72" containerID="138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37" exitCode=0 Aug 05 19:46:24.816412 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.816259 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" Aug 05 19:46:24.816412 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.816288 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" event={"ID":"8caa9421-e18b-4dd9-9b39-1115c8bf4b72","Type":"ContainerDied","Data":"138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37"} Aug 05 19:46:24.816412 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.816349 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc" event={"ID":"8caa9421-e18b-4dd9-9b39-1115c8bf4b72","Type":"ContainerDied","Data":"625f64e24766494293da65023a579bdace0876d60bd45dbcdd301aa700b77687"} Aug 05 19:46:24.816412 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.816380 2578 scope.go:117] "RemoveContainer" containerID="138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37" Aug 05 19:46:24.826881 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.826601 2578 scope.go:117] "RemoveContainer" containerID="138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37" Aug 05 19:46:24.827129 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:46:24.826955 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37\": container with ID starting with 138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37 not found: ID does not exist" containerID="138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37" Aug 05 19:46:24.827129 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.826982 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37"} err="failed to get container status \"138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37\": rpc error: code = NotFound desc = could not find container \"138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37\": container with ID starting with 138ac5472168e4599d8b57c87a37b47f4fc2abbfc2c81f6c1030a375813b9c37 not found: ID does not exist" Aug 05 19:46:24.834337 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.834310 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc"] Aug 05 19:46:24.836222 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:24.836198 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a47f42-dfbc6455b-2dcbc"] Aug 05 19:46:26.538492 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:26.538457 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8caa9421-e18b-4dd9-9b39-1115c8bf4b72" path="/var/lib/kubelet/pods/8caa9421-e18b-4dd9-9b39-1115c8bf4b72/volumes" Aug 05 19:46:30.488496 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:30.488459 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk"] Aug 05 19:46:30.488930 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:30.488686 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" containerID="cri-o://8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a" gracePeriod=30 Aug 05 19:46:31.169193 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.169151 2578 patch_prober.go:28] interesting pod/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 19:46:31.169345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.169226 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 19:46:31.284338 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.284299 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp"] Aug 05 19:46:31.284939 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.284917 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" Aug 05 19:46:31.285124 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.285102 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" Aug 05 19:46:31.285251 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.285138 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8caa9421-e18b-4dd9-9b39-1115c8bf4b72" containerName="payload-pre-processing" Aug 05 19:46:31.285251 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.285148 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8caa9421-e18b-4dd9-9b39-1115c8bf4b72" containerName="payload-pre-processing" Aug 05 19:46:31.285368 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.285280 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" Aug 05 19:46:31.285368 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.285297 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" Aug 05 19:46:31.285368 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.285305 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8caa9421-e18b-4dd9-9b39-1115c8bf4b72" containerName="payload-pre-processing" Aug 05 19:46:31.290226 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.290205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.292820 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.292798 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6a2d7d-openshift-default-dockercfg-h9qt4\"" Aug 05 19:46:31.301987 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.301965 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp"] Aug 05 19:46:31.384117 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-podinfo\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.384307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-credential-socket\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.384307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-socket\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.384307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hcxt\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-kube-api-access-5hcxt\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.384307 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-certs\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.384533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istiod-ca-cert\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.384533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-envoy\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.384533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-data\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.384533 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.384461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-token\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485348 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-token\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485348 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-podinfo\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485348 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-credential-socket\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485628 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-socket\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485628 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hcxt\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-kube-api-access-5hcxt\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485628 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-certs\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485628 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istiod-ca-cert\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485628 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-envoy\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485916 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-data\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.485970 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485943 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-credential-socket\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.486024 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.485943 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-certs\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.486081 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.486061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-data\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.486145 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.486123 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-socket\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.486367 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.486345 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istiod-ca-cert\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.488023 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.488001 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-envoy\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.488305 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.488285 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-podinfo\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.493823 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.493792 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-token\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.494236 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.494095 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hcxt\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-kube-api-access-5hcxt\") pod \"e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.601378 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.601340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:31.773773 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.773717 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp"] Aug 05 19:46:31.775478 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:46:31.775446 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bdc8bd0_63fa_4ab2_bbba_60ff18d0c9e1.slice/crio-55981a1bb6eca2a5514936e89733fb82cda77d0c0d56d9dcb771ad1b59301529 WatchSource:0}: Error finding container 55981a1bb6eca2a5514936e89733fb82cda77d0c0d56d9dcb771ad1b59301529: Status 404 returned error can't find the container with id 55981a1bb6eca2a5514936e89733fb82cda77d0c0d56d9dcb771ad1b59301529 Aug 05 19:46:31.778001 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.777960 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:46:31.778106 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.778038 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:46:31.778106 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.778077 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:46:31.854102 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.854067 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" event={"ID":"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1","Type":"ContainerStarted","Data":"faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864"} Aug 05 19:46:31.854272 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.854124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" event={"ID":"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1","Type":"ContainerStarted","Data":"55981a1bb6eca2a5514936e89733fb82cda77d0c0d56d9dcb771ad1b59301529"} Aug 05 19:46:31.874705 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:31.874639 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" podStartSLOduration=0.874619141 podStartE2EDuration="874.619141ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:46:31.873202406 +0000 UTC m=+2717.893265457" watchObservedRunningTime="2026-08-05 19:46:31.874619141 +0000 UTC m=+2717.894682189" Aug 05 19:46:32.602306 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:32.602267 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:32.604255 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:32.604217 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Aug 05 19:46:32.604406 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:32.604299 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Aug 05 19:46:33.605717 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:33.605688 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:33.865384 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:33.865287 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:33.866253 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:33.866230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:35.761175 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.761106 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:46:35.833837 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.833796 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-certs\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834041 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.833857 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-istio-token\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834041 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.833882 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-data\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834041 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.833937 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-socket\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834041 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834007 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-credential-socket\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834041 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834034 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-envoy\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834298 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834060 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00d98863-d3f3-45ea-8486-729f11e2944a-istio-podinfo\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834298 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834087 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llgll\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-kube-api-access-llgll\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834298 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834128 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:35.834298 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834177 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00d98863-d3f3-45ea-8486-729f11e2944a-istiod-ca-cert\") pod \"00d98863-d3f3-45ea-8486-729f11e2944a\" (UID: \"00d98863-d3f3-45ea-8486-729f11e2944a\") " Aug 05 19:46:35.834298 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834178 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-data" (OuterVolumeSpecName: "istio-data") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:35.834527 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834331 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:35.834527 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834383 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:35.834635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834565 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:35.834635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834579 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d98863-d3f3-45ea-8486-729f11e2944a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:46:35.834635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834588 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:35.834635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834604 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:35.834635 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.834618 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:35.836345 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.836319 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-istio-token" (OuterVolumeSpecName: "istio-token") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:46:35.836456 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.836360 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00d98863-d3f3-45ea-8486-729f11e2944a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 19:46:35.836743 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.836716 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-kube-api-access-llgll" (OuterVolumeSpecName: "kube-api-access-llgll") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "kube-api-access-llgll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:46:35.836743 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.836718 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00d98863-d3f3-45ea-8486-729f11e2944a" (UID: "00d98863-d3f3-45ea-8486-729f11e2944a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 19:46:35.877086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.877052 2578 generic.go:356] "Generic (PLEG): container finished" podID="00d98863-d3f3-45ea-8486-729f11e2944a" containerID="8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a" exitCode=0 Aug 05 19:46:35.877239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.877102 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" Aug 05 19:46:35.877239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.877139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" event={"ID":"00d98863-d3f3-45ea-8486-729f11e2944a","Type":"ContainerDied","Data":"8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a"} Aug 05 19:46:35.877239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.877204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk" event={"ID":"00d98863-d3f3-45ea-8486-729f11e2944a","Type":"ContainerDied","Data":"82b0b67abd097da19cacab19bd4c38c35b7433975d8cf28cba72e2d8bd656da5"} Aug 05 19:46:35.877239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.877232 2578 scope.go:117] "RemoveContainer" containerID="8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a" Aug 05 19:46:35.887003 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.886984 2578 scope.go:117] "RemoveContainer" containerID="55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971" Aug 05 19:46:35.895628 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.895608 2578 scope.go:117] "RemoveContainer" containerID="8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a" Aug 05 19:46:35.895918 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:46:35.895895 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a\": container with ID starting with 8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a not found: ID does not exist" containerID="8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a" Aug 05 19:46:35.895985 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.895927 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a"} err="failed to get container status \"8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a\": rpc error: code = NotFound desc = could not find container \"8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a\": container with ID starting with 8d4b25d32b979f182aeb1086c943a3e7d0cb4cf80122d5fb6231ca2e8a3aff5a not found: ID does not exist" Aug 05 19:46:35.895985 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.895943 2578 scope.go:117] "RemoveContainer" containerID="55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971" Aug 05 19:46:35.896181 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:46:35.896163 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971\": container with ID starting with 55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971 not found: ID does not exist" containerID="55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971" Aug 05 19:46:35.896222 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.896188 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971"} err="failed to get container status \"55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971\": rpc error: code = NotFound desc = could not find container \"55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971\": container with ID starting with 55b7d88802c4630fd1567beb00c68c4b11ed4bf6e8a2ba6ef755c26e33677971 not found: ID does not exist" Aug 05 19:46:35.900089 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.900061 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk"] Aug 05 19:46:35.909127 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.909103 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a47f42-openshift-default-75cc89cf74-gt6jk"] Aug 05 19:46:35.936099 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.936066 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00d98863-d3f3-45ea-8486-729f11e2944a-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:35.936099 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.936096 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:35.936099 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.936105 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00d98863-d3f3-45ea-8486-729f11e2944a-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:35.936099 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.936113 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00d98863-d3f3-45ea-8486-729f11e2944a-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:35.936355 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:35.936121 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llgll\" (UniqueName: \"kubernetes.io/projected/00d98863-d3f3-45ea-8486-729f11e2944a-kube-api-access-llgll\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:46:36.538516 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:36.538479 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" path="/var/lib/kubelet/pods/00d98863-d3f3-45ea-8486-729f11e2944a/volumes" Aug 05 19:46:47.954161 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:47.954068 2578 generic.go:356] "Generic (PLEG): container finished" podID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerID="faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864" exitCode=0 Aug 05 19:46:47.954161 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:47.954136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" event={"ID":"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1","Type":"ContainerDied","Data":"faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864"} Aug 05 19:46:47.954671 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:47.954655 2578 scope.go:117] "RemoveContainer" containerID="faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864" Aug 05 19:46:47.956007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:47.955976 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:46:47.956089 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:47.956068 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:46:47.956126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:47.956114 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:46:48.865611 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:48.865572 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:48.962450 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:48.962416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" event={"ID":"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1","Type":"ContainerStarted","Data":"d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef"} Aug 05 19:46:49.602517 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:49.602476 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:49.603795 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:49.603745 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Aug 05 19:46:49.603929 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:49.603818 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Aug 05 19:46:50.602774 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:50.602706 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Aug 05 19:46:50.603212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:50.602795 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Aug 05 19:46:51.602648 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:51.602609 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Aug 05 19:46:51.602883 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:51.602677 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Aug 05 19:46:52.602043 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:52.602000 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Aug 05 19:46:52.602238 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:52.602064 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Aug 05 19:46:53.602784 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:53.602713 2578 patch_prober.go:28] interesting pod/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body= Aug 05 19:46:53.603312 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:53.602817 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" Aug 05 19:46:54.606580 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:54.606547 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:54.607097 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:54.606819 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:54.607616 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:54.607597 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 19:46:59.291525 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.291485 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57"] Aug 05 19:46:59.292231 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.292208 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" Aug 05 19:46:59.292294 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.292236 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="62072b24-a758-4b9e-9438-33ebe8b2ef3e" containerName="istio-proxy" Aug 05 19:46:59.292294 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.292268 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" Aug 05 19:46:59.292294 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.292279 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" Aug 05 19:46:59.292524 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.292292 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" Aug 05 19:46:59.292524 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.292302 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" Aug 05 19:46:59.292524 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.292417 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" Aug 05 19:46:59.292524 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.292434 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="00d98863-d3f3-45ea-8486-729f11e2944a" containerName="istio-proxy" Aug 05 19:46:59.296263 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.296235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.299107 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.299080 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1df35a-openshift-default-dockercfg-6tfw9\"" Aug 05 19:46:59.306212 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.306181 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57"] Aug 05 19:46:59.469871 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.469826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-certs\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.469871 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.469874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-credential-socket\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.470153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.469901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-data\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.470153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.469969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xg6b\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-kube-api-access-8xg6b\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.470153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.470078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279367f7-7950-4742-b1d3-d6f65a39b4ce-istiod-ca-cert\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.470153 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.470132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-token\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.470341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.470171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-envoy\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.470341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.470203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-socket\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.470341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.470264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-podinfo\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.571090 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.571060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279367f7-7950-4742-b1d3-d6f65a39b4ce-istiod-ca-cert\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.571272 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.571104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-token\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.571272 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.571141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-envoy\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.571272 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.571162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-socket\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.571272 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.571195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-podinfo\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.571272 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.571234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-certs\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.571503 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.571314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-credential-socket\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.571503 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.571350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-data\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.572417 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.572383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xg6b\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-kube-api-access-8xg6b\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.572730 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.572587 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279367f7-7950-4742-b1d3-d6f65a39b4ce-istiod-ca-cert\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.572730 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.572629 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-credential-socket\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.573034 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.572942 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-certs\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.573187 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.573168 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-data\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.575127 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.575094 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-envoy\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.575229 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.575206 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-podinfo\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.581763 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.581716 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-token\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.581993 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.581970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xg6b\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-kube-api-access-8xg6b\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.583671 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.583510 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-socket\") pod \"e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.609439 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.609397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:46:59.752320 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.752289 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57"] Aug 05 19:46:59.753720 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:46:59.753695 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279367f7_7950_4742_b1d3_d6f65a39b4ce.slice/crio-9d3391a9ef14e8d6760c62494cd9dee519e50115b4174626420352315bed076e WatchSource:0}: Error finding container 9d3391a9ef14e8d6760c62494cd9dee519e50115b4174626420352315bed076e: Status 404 returned error can't find the container with id 9d3391a9ef14e8d6760c62494cd9dee519e50115b4174626420352315bed076e Aug 05 19:46:59.759355 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.759319 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:46:59.759479 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.759390 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:46:59.759479 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:46:59.759422 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:47:00.022492 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:00.022457 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" event={"ID":"279367f7-7950-4742-b1d3-d6f65a39b4ce","Type":"ContainerStarted","Data":"afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62"} Aug 05 19:47:00.022683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:00.022514 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" event={"ID":"279367f7-7950-4742-b1d3-d6f65a39b4ce","Type":"ContainerStarted","Data":"9d3391a9ef14e8d6760c62494cd9dee519e50115b4174626420352315bed076e"} Aug 05 19:47:00.045322 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:00.045266 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podStartSLOduration=1.045249181 podStartE2EDuration="1.045249181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:46:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:47:00.042451594 +0000 UTC m=+2746.062514642" watchObservedRunningTime="2026-08-05 19:47:00.045249181 +0000 UTC m=+2746.065312228" Aug 05 19:47:00.609601 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:00.609553 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:47:00.615477 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:00.615443 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:47:01.028257 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:01.028160 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:47:01.029200 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:01.029177 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:47:03.790683 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:03.790644 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2"] Aug 05 19:47:03.794525 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:03.794507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:03.797465 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:03.797438 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-1df35a\"" Aug 05 19:47:03.797611 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:03.797472 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-1df35a-dockercfg-twdjp\"" Aug 05 19:47:03.804803 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:03.804019 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2"] Aug 05 19:47:03.916945 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:03.916901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2\" (UID: \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:03.917142 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:03.917073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggdkw\" (UniqueName: \"kubernetes.io/projected/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-kube-api-access-ggdkw\") pod \"payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2\" (UID: \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:04.018331 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:04.018286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2\" (UID: \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:04.018548 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:04.018427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggdkw\" (UniqueName: \"kubernetes.io/projected/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-kube-api-access-ggdkw\") pod \"payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2\" (UID: \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:04.019143 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:04.019121 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2\" (UID: \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:04.027609 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:04.027576 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggdkw\" (UniqueName: \"kubernetes.io/projected/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-kube-api-access-ggdkw\") pod \"payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2\" (UID: \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:04.108897 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:04.108854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:04.253520 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:04.253481 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2"] Aug 05 19:47:04.255757 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:47:04.255709 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce4ac60_fcdd_4a34_a10b_faf20b2a34fb.slice/crio-0f9a6b05007e5f7cff323bed65e7a10cdb3d7b068b075e0c200c3714910afb9e WatchSource:0}: Error finding container 0f9a6b05007e5f7cff323bed65e7a10cdb3d7b068b075e0c200c3714910afb9e: Status 404 returned error can't find the container with id 0f9a6b05007e5f7cff323bed65e7a10cdb3d7b068b075e0c200c3714910afb9e Aug 05 19:47:05.051953 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:05.051919 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" event={"ID":"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb","Type":"ContainerStarted","Data":"4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc"} Aug 05 19:47:05.052384 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:05.051981 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:05.052384 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:05.052002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" event={"ID":"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb","Type":"ContainerStarted","Data":"0f9a6b05007e5f7cff323bed65e7a10cdb3d7b068b075e0c200c3714910afb9e"} Aug 05 19:47:05.067723 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:05.067671 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" podStartSLOduration=2.067652848 podStartE2EDuration="2.067652848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:47:05.066355586 +0000 UTC m=+2751.086418635" watchObservedRunningTime="2026-08-05 19:47:05.067652848 +0000 UTC m=+2751.087715895" Aug 05 19:47:16.029671 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.029561 2578 patch_prober.go:28] interesting pod/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Aug 05 19:47:16.029671 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.029644 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Aug 05 19:47:16.062146 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.062117 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 19:47:16.117099 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.117066 2578 generic.go:356] "Generic (PLEG): container finished" podID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerID="afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62" exitCode=0 Aug 05 19:47:16.117272 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.117137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" event={"ID":"279367f7-7950-4742-b1d3-d6f65a39b4ce","Type":"ContainerDied","Data":"afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62"} Aug 05 19:47:16.117706 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.117685 2578 scope.go:117] "RemoveContainer" containerID="afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62" Aug 05 19:47:16.118976 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.118943 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:47:16.119110 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.119032 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:47:16.119110 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:16.119082 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:47:17.127267 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:17.127220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" event={"ID":"279367f7-7950-4742-b1d3-d6f65a39b4ce","Type":"ContainerStarted","Data":"74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd"} Aug 05 19:47:17.610064 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:17.610024 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:47:17.610310 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:17.610287 2578 patch_prober.go:28] interesting pod/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Aug 05 19:47:17.610356 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:17.610342 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Aug 05 19:47:18.610301 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:18.610258 2578 patch_prober.go:28] interesting pod/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Aug 05 19:47:18.610724 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:18.610331 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Aug 05 19:47:19.609833 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:19.609792 2578 patch_prober.go:28] interesting pod/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Aug 05 19:47:19.610026 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:19.609852 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Aug 05 19:47:20.610636 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:20.610600 2578 patch_prober.go:28] interesting pod/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Aug 05 19:47:20.611110 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:20.610674 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Aug 05 19:47:21.610185 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:21.610152 2578 patch_prober.go:28] interesting pod/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Aug 05 19:47:21.610354 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:21.610225 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Aug 05 19:47:22.614467 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:22.614433 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:47:22.614921 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:22.614696 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:47:22.615374 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:47:22.615356 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 19:51:14.718903 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:51:14.718863 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:51:14.727823 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:51:14.727792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:56:11.579637 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:11.579600 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7627-139713598675632"] Aug 05 19:56:11.583361 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:11.583338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598675632" Aug 05 19:56:11.586083 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:11.586054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nrk4n\"" Aug 05 19:56:11.592327 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:11.592291 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598675632"] Aug 05 19:56:11.674063 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:11.674017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm5vv\" (UniqueName: \"kubernetes.io/projected/57692863-ccba-4383-97bb-f6c8ab717422-kube-api-access-wm5vv\") pod \"test-curl-7627-139713598675632\" (UID: \"57692863-ccba-4383-97bb-f6c8ab717422\") " pod="opendatahub/test-curl-7627-139713598675632" Aug 05 19:56:11.775383 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:11.775337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5vv\" (UniqueName: \"kubernetes.io/projected/57692863-ccba-4383-97bb-f6c8ab717422-kube-api-access-wm5vv\") pod \"test-curl-7627-139713598675632\" (UID: \"57692863-ccba-4383-97bb-f6c8ab717422\") " pod="opendatahub/test-curl-7627-139713598675632" Aug 05 19:56:11.783219 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:11.783189 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm5vv\" (UniqueName: \"kubernetes.io/projected/57692863-ccba-4383-97bb-f6c8ab717422-kube-api-access-wm5vv\") pod \"test-curl-7627-139713598675632\" (UID: \"57692863-ccba-4383-97bb-f6c8ab717422\") " pod="opendatahub/test-curl-7627-139713598675632" Aug 05 19:56:11.894801 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:11.894662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598675632" Aug 05 19:56:12.039316 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:12.039287 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598675632"] Aug 05 19:56:12.041895 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:56:12.041858 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57692863_ccba_4383_97bb_f6c8ab717422.slice/crio-9a81e98b00dfbb2e53cb6b4d67c211fb84b6bc13b46d338b0daecd6d292c7568 WatchSource:0}: Error finding container 9a81e98b00dfbb2e53cb6b4d67c211fb84b6bc13b46d338b0daecd6d292c7568: Status 404 returned error can't find the container with id 9a81e98b00dfbb2e53cb6b4d67c211fb84b6bc13b46d338b0daecd6d292c7568 Aug 05 19:56:12.043234 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:12.043205 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 19:56:13.017481 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:13.017387 2578 generic.go:356] "Generic (PLEG): container finished" podID="57692863-ccba-4383-97bb-f6c8ab717422" containerID="80469c6d9a58dd4ed3666265425c35aae1930a1cd6f52f33e12540fe94ad9f4e" exitCode=0 Aug 05 19:56:13.017876 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:13.017475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598675632" event={"ID":"57692863-ccba-4383-97bb-f6c8ab717422","Type":"ContainerDied","Data":"80469c6d9a58dd4ed3666265425c35aae1930a1cd6f52f33e12540fe94ad9f4e"} Aug 05 19:56:13.017876 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:13.017518 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598675632" event={"ID":"57692863-ccba-4383-97bb-f6c8ab717422","Type":"ContainerStarted","Data":"9a81e98b00dfbb2e53cb6b4d67c211fb84b6bc13b46d338b0daecd6d292c7568"} Aug 05 19:56:14.180267 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.180238 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598675632" Aug 05 19:56:14.211884 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.211853 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7627-139713598675632_57692863-ccba-4383-97bb-f6c8ab717422/test-curl-7627-139713598675632/0.log" Aug 05 19:56:14.231264 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.231225 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7627-139713598675632"] Aug 05 19:56:14.234482 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.234452 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7627-139713598675632"] Aug 05 19:56:14.301918 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.301884 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm5vv\" (UniqueName: \"kubernetes.io/projected/57692863-ccba-4383-97bb-f6c8ab717422-kube-api-access-wm5vv\") pod \"57692863-ccba-4383-97bb-f6c8ab717422\" (UID: \"57692863-ccba-4383-97bb-f6c8ab717422\") " Aug 05 19:56:14.304191 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.304160 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57692863-ccba-4383-97bb-f6c8ab717422-kube-api-access-wm5vv" (OuterVolumeSpecName: "kube-api-access-wm5vv") pod "57692863-ccba-4383-97bb-f6c8ab717422" (UID: "57692863-ccba-4383-97bb-f6c8ab717422"). InnerVolumeSpecName "kube-api-access-wm5vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:56:14.403626 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.403580 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm5vv\" (UniqueName: \"kubernetes.io/projected/57692863-ccba-4383-97bb-f6c8ab717422-kube-api-access-wm5vv\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:56:14.538342 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.538295 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57692863-ccba-4383-97bb-f6c8ab717422" path="/var/lib/kubelet/pods/57692863-ccba-4383-97bb-f6c8ab717422/volumes" Aug 05 19:56:14.759257 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.759165 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:56:14.768137 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:14.768111 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 19:56:15.030074 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:15.029988 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598675632" Aug 05 19:56:15.030074 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:15.030022 2578 scope.go:117] "RemoveContainer" containerID="80469c6d9a58dd4ed3666265425c35aae1930a1cd6f52f33e12540fe94ad9f4e" Aug 05 19:56:20.548257 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.548226 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7627-139713598508320"] Aug 05 19:56:20.548682 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.548633 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57692863-ccba-4383-97bb-f6c8ab717422" containerName="test-curl-7627-139713598675632" Aug 05 19:56:20.548682 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.548645 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="57692863-ccba-4383-97bb-f6c8ab717422" containerName="test-curl-7627-139713598675632" Aug 05 19:56:20.548786 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.548736 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="57692863-ccba-4383-97bb-f6c8ab717422" containerName="test-curl-7627-139713598675632" Aug 05 19:56:20.553240 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.553223 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:20.556086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.556058 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nrk4n\"" Aug 05 19:56:20.558078 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.558054 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598508320"] Aug 05 19:56:20.664663 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.664621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl95v\" (UniqueName: \"kubernetes.io/projected/eafd4b59-9171-4ba4-a627-f766c779de86-kube-api-access-gl95v\") pod \"test-curl-7627-139713598508320\" (UID: \"eafd4b59-9171-4ba4-a627-f766c779de86\") " pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:20.765602 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.765548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl95v\" (UniqueName: \"kubernetes.io/projected/eafd4b59-9171-4ba4-a627-f766c779de86-kube-api-access-gl95v\") pod \"test-curl-7627-139713598508320\" (UID: \"eafd4b59-9171-4ba4-a627-f766c779de86\") " pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:20.777151 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.775465 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl95v\" (UniqueName: \"kubernetes.io/projected/eafd4b59-9171-4ba4-a627-f766c779de86-kube-api-access-gl95v\") pod \"test-curl-7627-139713598508320\" (UID: \"eafd4b59-9171-4ba4-a627-f766c779de86\") " pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:20.863678 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:20.863646 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:21.002317 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:21.002288 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7627-139713598508320"] Aug 05 19:56:21.004437 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:56:21.004399 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeafd4b59_9171_4ba4_a627_f766c779de86.slice/crio-659e1545423f20d8716b12f20847e484999df3de276fdbbc30ead6d2a7a67082 WatchSource:0}: Error finding container 659e1545423f20d8716b12f20847e484999df3de276fdbbc30ead6d2a7a67082: Status 404 returned error can't find the container with id 659e1545423f20d8716b12f20847e484999df3de276fdbbc30ead6d2a7a67082 Aug 05 19:56:21.063643 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:21.063601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598508320" event={"ID":"eafd4b59-9171-4ba4-a627-f766c779de86","Type":"ContainerStarted","Data":"659e1545423f20d8716b12f20847e484999df3de276fdbbc30ead6d2a7a67082"} Aug 05 19:56:22.071609 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:22.071573 2578 generic.go:356] "Generic (PLEG): container finished" podID="eafd4b59-9171-4ba4-a627-f766c779de86" containerID="96467b1c4dd9f906744c636744d825ad1ee8197b2912bb9d3f484946b679e6c5" exitCode=0 Aug 05 19:56:22.072056 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:22.071617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7627-139713598508320" event={"ID":"eafd4b59-9171-4ba4-a627-f766c779de86","Type":"ContainerDied","Data":"96467b1c4dd9f906744c636744d825ad1ee8197b2912bb9d3f484946b679e6c5"} Aug 05 19:56:23.223474 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:23.223447 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:23.250064 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:23.250034 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7627-139713598508320_eafd4b59-9171-4ba4-a627-f766c779de86/test-curl-7627-139713598508320/0.log" Aug 05 19:56:23.277347 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:23.277308 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7627-139713598508320"] Aug 05 19:56:23.280705 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:23.280677 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7627-139713598508320"] Aug 05 19:56:23.287743 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:23.287712 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl95v\" (UniqueName: \"kubernetes.io/projected/eafd4b59-9171-4ba4-a627-f766c779de86-kube-api-access-gl95v\") pod \"eafd4b59-9171-4ba4-a627-f766c779de86\" (UID: \"eafd4b59-9171-4ba4-a627-f766c779de86\") " Aug 05 19:56:23.289867 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:23.289834 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eafd4b59-9171-4ba4-a627-f766c779de86-kube-api-access-gl95v" (OuterVolumeSpecName: "kube-api-access-gl95v") pod "eafd4b59-9171-4ba4-a627-f766c779de86" (UID: "eafd4b59-9171-4ba4-a627-f766c779de86"). InnerVolumeSpecName "kube-api-access-gl95v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:56:23.389124 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:23.389024 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl95v\" (UniqueName: \"kubernetes.io/projected/eafd4b59-9171-4ba4-a627-f766c779de86-kube-api-access-gl95v\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:56:24.083903 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:24.083871 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:24.083903 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:24.083886 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="659e1545423f20d8716b12f20847e484999df3de276fdbbc30ead6d2a7a67082" Aug 05 19:56:24.093981 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:56:24.093950 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7627-139713598508320\" is forbidden: User \"system:node:ip-10-0-131-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-134.ec2.internal' and this object" podUID="eafd4b59-9171-4ba4-a627-f766c779de86" pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:24.536093 ip-10-0-131-134 kubenswrapper[2578]: E0805 19:56:24.535998 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7627-139713598508320\" is forbidden: User \"system:node:ip-10-0-131-134.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-134.ec2.internal' and this object" podUID="eafd4b59-9171-4ba4-a627-f766c779de86" pod="opendatahub/test-curl-7627-139713598508320" Aug 05 19:56:24.537955 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:24.537924 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eafd4b59-9171-4ba4-a627-f766c779de86" path="/var/lib/kubelet/pods/eafd4b59-9171-4ba4-a627-f766c779de86/volumes" Aug 05 19:56:30.219394 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.219359 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b"] Aug 05 19:56:30.219875 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.219835 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eafd4b59-9171-4ba4-a627-f766c779de86" containerName="test-curl-7627-139713598508320" Aug 05 19:56:30.219875 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.219848 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eafd4b59-9171-4ba4-a627-f766c779de86" containerName="test-curl-7627-139713598508320" Aug 05 19:56:30.220007 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.219912 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eafd4b59-9171-4ba4-a627-f766c779de86" containerName="test-curl-7627-139713598508320" Aug 05 19:56:30.223239 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.223218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.226021 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.225992 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-c686d7-openshift-default-dockercfg-wkhxj\"" Aug 05 19:56:30.236733 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.236699 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b"] Aug 05 19:56:30.357341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-envoy\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.357341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-data\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.357600 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-socket\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.357600 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k6dh\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-kube-api-access-5k6dh\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.357600 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-certs\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.357600 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-podinfo\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.357600 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-token\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.357883 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-credential-socket\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.357883 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.357693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af6a5081-75e3-47d5-9f8a-87ee8de10134-istiod-ca-cert\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458280 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-credential-socket\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458280 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af6a5081-75e3-47d5-9f8a-87ee8de10134-istiod-ca-cert\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458553 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-envoy\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458553 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-data\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458553 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-socket\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458553 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k6dh\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-kube-api-access-5k6dh\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458812 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-certs\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458812 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-podinfo\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458812 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-token\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.458812 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458731 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-credential-socket\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.459035 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458926 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-data\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.459035 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.458970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-socket\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.459152 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.459054 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-certs\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.459242 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.459218 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af6a5081-75e3-47d5-9f8a-87ee8de10134-istiod-ca-cert\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.461059 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.461032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-envoy\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.461374 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.461351 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-podinfo\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.467282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.467258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-token\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.467397 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.467343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k6dh\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-kube-api-access-5k6dh\") pod \"e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.535870 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.535773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:30.695609 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.695581 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b"] Aug 05 19:56:30.697719 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:56:30.697691 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6a5081_75e3_47d5_9f8a_87ee8de10134.slice/crio-1273400b9f9a0d3bfcf588af74bb9b2dc86d15360bbdd8640dbfa5c2937b97a6 WatchSource:0}: Error finding container 1273400b9f9a0d3bfcf588af74bb9b2dc86d15360bbdd8640dbfa5c2937b97a6: Status 404 returned error can't find the container with id 1273400b9f9a0d3bfcf588af74bb9b2dc86d15360bbdd8640dbfa5c2937b97a6 Aug 05 19:56:30.700101 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.700051 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:56:30.700188 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.700155 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:56:30.700240 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:30.700208 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:56:31.125223 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:31.125179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" event={"ID":"af6a5081-75e3-47d5-9f8a-87ee8de10134","Type":"ContainerStarted","Data":"3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a"} Aug 05 19:56:31.125455 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:31.125248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" event={"ID":"af6a5081-75e3-47d5-9f8a-87ee8de10134","Type":"ContainerStarted","Data":"1273400b9f9a0d3bfcf588af74bb9b2dc86d15360bbdd8640dbfa5c2937b97a6"} Aug 05 19:56:31.144898 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:31.144839 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" podStartSLOduration=1.144821191 podStartE2EDuration="1.144821191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:56:31.14335628 +0000 UTC m=+3317.163419329" watchObservedRunningTime="2026-08-05 19:56:31.144821191 +0000 UTC m=+3317.164884308" Aug 05 19:56:31.536657 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:31.536570 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:31.542126 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:31.542096 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:32.131373 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:32.131337 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:32.132335 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:32.132313 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:47.133321 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:47.133276 2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Aug 05 19:56:47.133883 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:47.133356 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Aug 05 19:56:47.215102 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:47.215070 2578 generic.go:356] "Generic (PLEG): container finished" podID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerID="3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a" exitCode=0 Aug 05 19:56:47.215314 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:47.215149 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" event={"ID":"af6a5081-75e3-47d5-9f8a-87ee8de10134","Type":"ContainerDied","Data":"3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a"} Aug 05 19:56:47.215657 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:47.215639 2578 scope.go:117] "RemoveContainer" containerID="3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a" Aug 05 19:56:47.216808 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:47.216778 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:56:47.216894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:47.216845 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:56:47.216894 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:47.216878 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Aug 05 19:56:48.240734 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:48.240679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" event={"ID":"af6a5081-75e3-47d5-9f8a-87ee8de10134","Type":"ContainerStarted","Data":"8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685"} Aug 05 19:56:48.538002 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:48.537886 2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Aug 05 19:56:48.538002 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:48.537967 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Aug 05 19:56:48.543355 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:48.543311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:49.536952 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:49.536906 2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Aug 05 19:56:49.537456 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:49.536993 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Aug 05 19:56:50.536274 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:50.536229 2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Aug 05 19:56:50.536611 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:50.536297 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Aug 05 19:56:51.536881 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:51.536834 2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Aug 05 19:56:51.537411 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:51.536930 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Aug 05 19:56:52.536998 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:52.536940 2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Aug 05 19:56:52.538117 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:52.537661 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Aug 05 19:56:53.541081 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:53.541039 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:53.541548 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:53.541334 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:56:53.542106 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:56:53.542089 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 19:57:36.203895 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:57:36.203858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gfg5_c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9/payload-processing/0.log" Aug 05 19:58:21.102354 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:21.102316 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gfg5_c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9/payload-processing/0.log" Aug 05 19:58:26.604905 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.604854 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4"] Aug 05 19:58:26.608965 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.608939 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:26.611282 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.611257 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-75a4be\"" Aug 05 19:58:26.618445 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.618419 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4"] Aug 05 19:58:26.644308 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.644275 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9"] Aug 05 19:58:26.647922 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.647906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:26.650607 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.650587 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-75a4be-dockercfg-rkfsv\"" Aug 05 19:58:26.657596 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.657569 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9"] Aug 05 19:58:26.721086 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.721049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-kube-api-access-t99zn\") pod \"payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9\" (UID: \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:26.721265 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.721116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9\" (UID: \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:26.721265 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.721157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6822ae50-1e60-427a-aa05-8af4b7a04416-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4\" (UID: \"6822ae50-1e60-427a-aa05-8af4b7a04416\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:26.721265 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.721247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdwcn\" (UniqueName: \"kubernetes.io/projected/6822ae50-1e60-427a-aa05-8af4b7a04416-kube-api-access-sdwcn\") pod \"payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4\" (UID: \"6822ae50-1e60-427a-aa05-8af4b7a04416\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:26.821949 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.821900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdwcn\" (UniqueName: \"kubernetes.io/projected/6822ae50-1e60-427a-aa05-8af4b7a04416-kube-api-access-sdwcn\") pod \"payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4\" (UID: \"6822ae50-1e60-427a-aa05-8af4b7a04416\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:26.822462 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.822043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-kube-api-access-t99zn\") pod \"payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9\" (UID: \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:26.822462 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.822109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9\" (UID: \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:26.822462 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.822158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6822ae50-1e60-427a-aa05-8af4b7a04416-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4\" (UID: \"6822ae50-1e60-427a-aa05-8af4b7a04416\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:26.823298 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.823269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6822ae50-1e60-427a-aa05-8af4b7a04416-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4\" (UID: \"6822ae50-1e60-427a-aa05-8af4b7a04416\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:26.823605 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.823565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9\" (UID: \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:26.830422 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.830390 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-kube-api-access-t99zn\") pod \"payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9\" (UID: \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:26.830539 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.830397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdwcn\" (UniqueName: \"kubernetes.io/projected/6822ae50-1e60-427a-aa05-8af4b7a04416-kube-api-access-sdwcn\") pod \"payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4\" (UID: \"6822ae50-1e60-427a-aa05-8af4b7a04416\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:26.921194 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.921102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:26.960678 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:26.960639 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:27.083485 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.083400 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4"] Aug 05 19:58:27.087119 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:58:27.087084 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6822ae50_1e60_427a_aa05_8af4b7a04416.slice/crio-c7cd5652a8f9614c81420a309973343393b14b7bb51c9c096a3ace122aded6e6 WatchSource:0}: Error finding container c7cd5652a8f9614c81420a309973343393b14b7bb51c9c096a3ace122aded6e6: Status 404 returned error can't find the container with id c7cd5652a8f9614c81420a309973343393b14b7bb51c9c096a3ace122aded6e6 Aug 05 19:58:27.127868 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.127811 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9"] Aug 05 19:58:27.130840 ip-10-0-131-134 kubenswrapper[2578]: W0805 19:58:27.130813 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6225a9_faa1_43e8_b4b9_b4a547ad4633.slice/crio-7a795b39c777a688a10221fc8538dbba82dbf6225a19c16bccc5280683883db0 WatchSource:0}: Error finding container 7a795b39c777a688a10221fc8538dbba82dbf6225a19c16bccc5280683883db0: Status 404 returned error can't find the container with id 7a795b39c777a688a10221fc8538dbba82dbf6225a19c16bccc5280683883db0 Aug 05 19:58:27.780062 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.780024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" event={"ID":"9b6225a9-faa1-43e8-b4b9-b4a547ad4633","Type":"ContainerStarted","Data":"722ae538cdaf99924fd88b0778a15b13829912b3f5cecd7b2259e3ad465b4c20"} Aug 05 19:58:27.780523 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.780092 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:27.780523 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.780118 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" event={"ID":"9b6225a9-faa1-43e8-b4b9-b4a547ad4633","Type":"ContainerStarted","Data":"7a795b39c777a688a10221fc8538dbba82dbf6225a19c16bccc5280683883db0"} Aug 05 19:58:27.781578 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.781555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" event={"ID":"6822ae50-1e60-427a-aa05-8af4b7a04416","Type":"ContainerStarted","Data":"d481bea1f59fc1b21a10bdd396f75edacbf98838df2a49d64b7218bd9c811c1d"} Aug 05 19:58:27.781657 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.781603 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" event={"ID":"6822ae50-1e60-427a-aa05-8af4b7a04416","Type":"ContainerStarted","Data":"c7cd5652a8f9614c81420a309973343393b14b7bb51c9c096a3ace122aded6e6"} Aug 05 19:58:27.781657 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.781623 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:27.798764 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.798694 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" podStartSLOduration=1.798676881 podStartE2EDuration="1.798676881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:58:27.796492642 +0000 UTC m=+3433.816555691" watchObservedRunningTime="2026-08-05 19:58:27.798676881 +0000 UTC m=+3433.818739928" Aug 05 19:58:27.814622 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:27.814570 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" podStartSLOduration=1.814554463 podStartE2EDuration="1.814554463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 19:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 19:58:27.812654412 +0000 UTC m=+3433.832717461" watchObservedRunningTime="2026-08-05 19:58:27.814554463 +0000 UTC m=+3433.834617511" Aug 05 19:58:38.789138 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:38.789089 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" podUID="6822ae50-1e60-427a-aa05-8af4b7a04416" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.68:9004: connect: connection refused" Aug 05 19:58:38.789625 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:38.789499 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:48.787646 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:48.787610 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:56.655801 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.655765 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9"] Aug 05 19:58:56.656599 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.655990 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" podUID="9b6225a9-faa1-43e8-b4b9-b4a547ad4633" containerName="payload-processing" containerID="cri-o://722ae538cdaf99924fd88b0778a15b13829912b3f5cecd7b2259e3ad465b4c20" gracePeriod=30 Aug 05 19:58:56.664788 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.664742 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4"] Aug 05 19:58:56.665058 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.665007 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" podUID="6822ae50-1e60-427a-aa05-8af4b7a04416" containerName="payload-pre-processing" containerID="cri-o://d481bea1f59fc1b21a10bdd396f75edacbf98838df2a49d64b7218bd9c811c1d" gracePeriod=30 Aug 05 19:58:56.946029 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.945989 2578 generic.go:356] "Generic (PLEG): container finished" podID="6822ae50-1e60-427a-aa05-8af4b7a04416" containerID="d481bea1f59fc1b21a10bdd396f75edacbf98838df2a49d64b7218bd9c811c1d" exitCode=0 Aug 05 19:58:56.946209 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.946025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" event={"ID":"6822ae50-1e60-427a-aa05-8af4b7a04416","Type":"ContainerDied","Data":"d481bea1f59fc1b21a10bdd396f75edacbf98838df2a49d64b7218bd9c811c1d"} Aug 05 19:58:56.947595 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.947567 2578 generic.go:356] "Generic (PLEG): container finished" podID="9b6225a9-faa1-43e8-b4b9-b4a547ad4633" containerID="722ae538cdaf99924fd88b0778a15b13829912b3f5cecd7b2259e3ad465b4c20" exitCode=0 Aug 05 19:58:56.947713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.947624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" event={"ID":"9b6225a9-faa1-43e8-b4b9-b4a547ad4633","Type":"ContainerDied","Data":"722ae538cdaf99924fd88b0778a15b13829912b3f5cecd7b2259e3ad465b4c20"} Aug 05 19:58:56.947713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.947669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" event={"ID":"9b6225a9-faa1-43e8-b4b9-b4a547ad4633","Type":"ContainerDied","Data":"7a795b39c777a688a10221fc8538dbba82dbf6225a19c16bccc5280683883db0"} Aug 05 19:58:56.947713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.947692 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a795b39c777a688a10221fc8538dbba82dbf6225a19c16bccc5280683883db0" Aug 05 19:58:56.953444 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.953422 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:56.989432 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:56.989403 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:57.019879 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.019847 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6822ae50-1e60-427a-aa05-8af4b7a04416-plugins-config-volume\") pod \"6822ae50-1e60-427a-aa05-8af4b7a04416\" (UID: \"6822ae50-1e60-427a-aa05-8af4b7a04416\") " Aug 05 19:58:57.020083 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.019907 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-kube-api-access-t99zn\") pod \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\" (UID: \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\") " Aug 05 19:58:57.020157 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.020097 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdwcn\" (UniqueName: \"kubernetes.io/projected/6822ae50-1e60-427a-aa05-8af4b7a04416-kube-api-access-sdwcn\") pod \"6822ae50-1e60-427a-aa05-8af4b7a04416\" (UID: \"6822ae50-1e60-427a-aa05-8af4b7a04416\") " Aug 05 19:58:57.020214 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.020169 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-plugins-config-volume\") pod \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\" (UID: \"9b6225a9-faa1-43e8-b4b9-b4a547ad4633\") " Aug 05 19:58:57.020306 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.020277 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6822ae50-1e60-427a-aa05-8af4b7a04416-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6822ae50-1e60-427a-aa05-8af4b7a04416" (UID: "6822ae50-1e60-427a-aa05-8af4b7a04416"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:58:57.020571 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.020546 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6822ae50-1e60-427a-aa05-8af4b7a04416-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:58:57.020692 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.020605 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b6225a9-faa1-43e8-b4b9-b4a547ad4633" (UID: "9b6225a9-faa1-43e8-b4b9-b4a547ad4633"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 19:58:57.022691 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.022665 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6822ae50-1e60-427a-aa05-8af4b7a04416-kube-api-access-sdwcn" (OuterVolumeSpecName: "kube-api-access-sdwcn") pod "6822ae50-1e60-427a-aa05-8af4b7a04416" (UID: "6822ae50-1e60-427a-aa05-8af4b7a04416"). InnerVolumeSpecName "kube-api-access-sdwcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:58:57.022836 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.022697 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-kube-api-access-t99zn" (OuterVolumeSpecName: "kube-api-access-t99zn") pod "9b6225a9-faa1-43e8-b4b9-b4a547ad4633" (UID: "9b6225a9-faa1-43e8-b4b9-b4a547ad4633"). InnerVolumeSpecName "kube-api-access-t99zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 19:58:57.121207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.121166 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdwcn\" (UniqueName: \"kubernetes.io/projected/6822ae50-1e60-427a-aa05-8af4b7a04416-kube-api-access-sdwcn\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:58:57.121207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.121202 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:58:57.121207 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.121211 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t99zn\" (UniqueName: \"kubernetes.io/projected/9b6225a9-faa1-43e8-b4b9-b4a547ad4633-kube-api-access-t99zn\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 19:58:57.954848 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.954757 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" event={"ID":"6822ae50-1e60-427a-aa05-8af4b7a04416","Type":"ContainerDied","Data":"c7cd5652a8f9614c81420a309973343393b14b7bb51c9c096a3ace122aded6e6"} Aug 05 19:58:57.954848 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.954830 2578 scope.go:117] "RemoveContainer" containerID="d481bea1f59fc1b21a10bdd396f75edacbf98838df2a49d64b7218bd9c811c1d" Aug 05 19:58:57.955348 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.954772 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9" Aug 05 19:58:57.955348 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.954773 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4" Aug 05 19:58:57.983202 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.983168 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9"] Aug 05 19:58:57.989713 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:57.989685 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-75a4be-9f5d4787b-nc4w9"] Aug 05 19:58:58.001926 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:58.001899 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4"] Aug 05 19:58:58.009727 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:58.009698 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-75a4be-55d8bc9568-jbrd4"] Aug 05 19:58:58.538909 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:58.538858 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6822ae50-1e60-427a-aa05-8af4b7a04416" path="/var/lib/kubelet/pods/6822ae50-1e60-427a-aa05-8af4b7a04416/volumes" Aug 05 19:58:58.539341 ip-10-0-131-134 kubenswrapper[2578]: I0805 19:58:58.539320 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b6225a9-faa1-43e8-b4b9-b4a547ad4633" path="/var/lib/kubelet/pods/9b6225a9-faa1-43e8-b4b9-b4a547ad4633/volumes" Aug 05 20:00:25.137117 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:25.137079 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b"] Aug 05 20:00:25.137774 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:25.137338 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" containerID="cri-o://8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685" gracePeriod=30 Aug 05 20:00:30.415955 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.415878 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 20:00:30.475276 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.475239 2578 generic.go:356] "Generic (PLEG): container finished" podID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerID="8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685" exitCode=0 Aug 05 20:00:30.475473 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.475319 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" Aug 05 20:00:30.475473 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.475320 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" event={"ID":"af6a5081-75e3-47d5-9f8a-87ee8de10134","Type":"ContainerDied","Data":"8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685"} Aug 05 20:00:30.475473 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.475471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b" event={"ID":"af6a5081-75e3-47d5-9f8a-87ee8de10134","Type":"ContainerDied","Data":"1273400b9f9a0d3bfcf588af74bb9b2dc86d15360bbdd8640dbfa5c2937b97a6"} Aug 05 20:00:30.475602 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.475495 2578 scope.go:117] "RemoveContainer" containerID="8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685" Aug 05 20:00:30.484921 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.484901 2578 scope.go:117] "RemoveContainer" containerID="3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a" Aug 05 20:00:30.494421 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.494397 2578 scope.go:117] "RemoveContainer" containerID="8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685" Aug 05 20:00:30.494736 ip-10-0-131-134 kubenswrapper[2578]: E0805 20:00:30.494718 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685\": container with ID starting with 8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685 not found: ID does not exist" containerID="8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685" Aug 05 20:00:30.494798 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.494774 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685"} err="failed to get container status \"8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685\": rpc error: code = NotFound desc = could not find container \"8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685\": container with ID starting with 8ec21677de3799a11a5e7b34498a7efc98a0f0433e494b1e85dedee502e98685 not found: ID does not exist" Aug 05 20:00:30.494798 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.494795 2578 scope.go:117] "RemoveContainer" containerID="3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a" Aug 05 20:00:30.495035 ip-10-0-131-134 kubenswrapper[2578]: E0805 20:00:30.495017 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a\": container with ID starting with 3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a not found: ID does not exist" containerID="3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a" Aug 05 20:00:30.495090 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.495041 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a"} err="failed to get container status \"3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a\": rpc error: code = NotFound desc = could not find container \"3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a\": container with ID starting with 3d24bb34e4638147203c36f54c95c7ec180e0d767153f3807255fa5a599efa4a not found: ID does not exist" Aug 05 20:00:30.564668 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.564625 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af6a5081-75e3-47d5-9f8a-87ee8de10134-istiod-ca-cert\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.564904 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.564700 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-podinfo\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.564904 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.564802 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-credential-socket\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.564904 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.564868 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-data\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.564904 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.564893 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-certs\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.565130 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.564946 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k6dh\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-kube-api-access-5k6dh\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.565130 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565010 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-envoy\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.565130 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565030 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-token\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.565130 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565055 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-socket\") pod \"af6a5081-75e3-47d5-9f8a-87ee8de10134\" (UID: \"af6a5081-75e3-47d5-9f8a-87ee8de10134\") " Aug 05 20:00:30.565130 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565101 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af6a5081-75e3-47d5-9f8a-87ee8de10134-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 20:00:30.565380 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565163 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:00:30.565380 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565177 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-data" (OuterVolumeSpecName: "istio-data") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:00:30.565380 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565300 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:00:30.565542 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565436 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:00:30.565542 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565501 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af6a5081-75e3-47d5-9f8a-87ee8de10134-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.565542 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565524 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.565542 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565537 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.565764 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.565549 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.567179 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.567153 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 20:00:30.567372 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.567346 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-token" (OuterVolumeSpecName: "istio-token") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 20:00:30.567512 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.567429 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:00:30.567512 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.567482 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-kube-api-access-5k6dh" (OuterVolumeSpecName: "kube-api-access-5k6dh") pod "af6a5081-75e3-47d5-9f8a-87ee8de10134" (UID: "af6a5081-75e3-47d5-9f8a-87ee8de10134"). InnerVolumeSpecName "kube-api-access-5k6dh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 20:00:30.667129 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.667044 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.667129 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.667072 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k6dh\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-kube-api-access-5k6dh\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.667129 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.667083 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.667129 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.667091 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af6a5081-75e3-47d5-9f8a-87ee8de10134-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.667129 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.667099 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af6a5081-75e3-47d5-9f8a-87ee8de10134-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:00:30.800845 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.800805 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b"] Aug 05 20:00:30.807040 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:30.807010 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-c686d7-openshift-default-84d469bbf8-m4m4b"] Aug 05 20:00:32.538408 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:00:32.538372 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" path="/var/lib/kubelet/pods/af6a5081-75e3-47d5-9f8a-87ee8de10134/volumes" Aug 05 20:01:00.090615 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:00.090578 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp"] Aug 05 20:01:00.091204 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:00.090916 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" containerID="cri-o://d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef" gracePeriod=30 Aug 05 20:01:05.359884 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.359812 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 20:01:05.429440 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429400 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-podinfo\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429648 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429470 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-credential-socket\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429648 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429516 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-envoy\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429648 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429551 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-socket\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429648 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429592 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hcxt\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-kube-api-access-5hcxt\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429648 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429619 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-certs\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429955 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429732 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-data\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429955 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429790 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istiod-ca-cert\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429955 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429801 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:05.429955 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429838 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-token\") pod \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\" (UID: \"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1\") " Aug 05 20:01:05.429955 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429935 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:05.429955 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.429951 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:05.430279 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.430017 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:05.430347 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.430286 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.430347 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.430314 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.430347 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.430312 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 20:01:05.430347 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.430331 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.430347 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.430346 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.431853 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.431818 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 20:01:05.431967 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.431908 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:05.432032 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.431979 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-kube-api-access-5hcxt" (OuterVolumeSpecName: "kube-api-access-5hcxt") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "kube-api-access-5hcxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 20:01:05.432093 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.432050 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" (UID: "2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 20:01:05.530962 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.530930 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.530962 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.530956 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.530962 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.530967 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hcxt\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-kube-api-access-5hcxt\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.531262 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.530976 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.531262 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.530988 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:05.672645 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.672542 2578 generic.go:356] "Generic (PLEG): container finished" podID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerID="d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef" exitCode=0 Aug 05 20:01:05.672645 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.672590 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" Aug 05 20:01:05.672645 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.672631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" event={"ID":"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1","Type":"ContainerDied","Data":"d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef"} Aug 05 20:01:05.672954 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.672690 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp" event={"ID":"2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1","Type":"ContainerDied","Data":"55981a1bb6eca2a5514936e89733fb82cda77d0c0d56d9dcb771ad1b59301529"} Aug 05 20:01:05.672954 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.672720 2578 scope.go:117] "RemoveContainer" containerID="d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef" Aug 05 20:01:05.683251 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.683227 2578 scope.go:117] "RemoveContainer" containerID="faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864" Aug 05 20:01:05.691891 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.691868 2578 scope.go:117] "RemoveContainer" containerID="d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef" Aug 05 20:01:05.692180 ip-10-0-131-134 kubenswrapper[2578]: E0805 20:01:05.692159 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef\": container with ID starting with d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef not found: ID does not exist" containerID="d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef" Aug 05 20:01:05.692267 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.692195 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef"} err="failed to get container status \"d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef\": rpc error: code = NotFound desc = could not find container \"d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef\": container with ID starting with d979762ac09cc17e1163d82bdb0ce4041c63a31f86cfb4069d9afdbb9d7ad3ef not found: ID does not exist" Aug 05 20:01:05.692267 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.692222 2578 scope.go:117] "RemoveContainer" containerID="faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864" Aug 05 20:01:05.692475 ip-10-0-131-134 kubenswrapper[2578]: E0805 20:01:05.692458 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864\": container with ID starting with faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864 not found: ID does not exist" containerID="faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864" Aug 05 20:01:05.692532 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.692482 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864"} err="failed to get container status \"faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864\": rpc error: code = NotFound desc = could not find container \"faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864\": container with ID starting with faa2cb21169607203379efc49093a53577a13beb1a2ce04af0ad75911249a864 not found: ID does not exist" Aug 05 20:01:05.696947 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.696920 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp"] Aug 05 20:01:05.701103 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:05.701079 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6a2d7d-openshift-default-7579b59b-g6ssp"] Aug 05 20:01:06.539111 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:06.539030 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" path="/var/lib/kubelet/pods/2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1/volumes" Aug 05 20:01:11.383973 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.383933 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2"] Aug 05 20:01:11.384399 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.384220 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" podUID="9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb" containerName="payload-pre-processing" containerID="cri-o://4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc" gracePeriod=30 Aug 05 20:01:11.665315 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.665287 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 20:01:11.714668 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.714629 2578 generic.go:356] "Generic (PLEG): container finished" podID="9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb" containerID="4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc" exitCode=0 Aug 05 20:01:11.714885 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.714686 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" Aug 05 20:01:11.714885 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.714716 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" event={"ID":"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb","Type":"ContainerDied","Data":"4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc"} Aug 05 20:01:11.714885 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.714801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2" event={"ID":"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb","Type":"ContainerDied","Data":"0f9a6b05007e5f7cff323bed65e7a10cdb3d7b068b075e0c200c3714910afb9e"} Aug 05 20:01:11.714885 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.714874 2578 scope.go:117] "RemoveContainer" containerID="4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc" Aug 05 20:01:11.724993 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.724966 2578 scope.go:117] "RemoveContainer" containerID="4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc" Aug 05 20:01:11.725479 ip-10-0-131-134 kubenswrapper[2578]: E0805 20:01:11.725447 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc\": container with ID starting with 4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc not found: ID does not exist" containerID="4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc" Aug 05 20:01:11.725598 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.725486 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc"} err="failed to get container status \"4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc\": rpc error: code = NotFound desc = could not find container \"4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc\": container with ID starting with 4987c841df0cb9f9c888b60c720d4fa934b35cbc797b13fe550d3f5f5a26acfc not found: ID does not exist" Aug 05 20:01:11.794736 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.794694 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggdkw\" (UniqueName: \"kubernetes.io/projected/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-kube-api-access-ggdkw\") pod \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\" (UID: \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\") " Aug 05 20:01:11.794950 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.794778 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-plugins-config-volume\") pod \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\" (UID: \"9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb\") " Aug 05 20:01:11.795268 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.795226 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb" (UID: "9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 20:01:11.797290 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.797267 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-kube-api-access-ggdkw" (OuterVolumeSpecName: "kube-api-access-ggdkw") pod "9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb" (UID: "9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb"). InnerVolumeSpecName "kube-api-access-ggdkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 20:01:11.896390 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.896294 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggdkw\" (UniqueName: \"kubernetes.io/projected/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-kube-api-access-ggdkw\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:11.896390 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:11.896330 2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb-plugins-config-volume\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:12.040628 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:12.040587 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2"] Aug 05 20:01:12.045995 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:12.045958 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-1df35a-bfccd49bd-htxc2"] Aug 05 20:01:12.542317 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:12.542266 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb" path="/var/lib/kubelet/pods/9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb/volumes" Aug 05 20:01:14.790078 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:14.790050 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 20:01:14.803838 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:14.803809 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 20:01:18.275009 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:18.274957 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57"] Aug 05 20:01:18.275462 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:18.275205 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" containerID="cri-o://74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd" gracePeriod=30 Aug 05 20:01:22.617927 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:22.617885 2578 patch_prober.go:28] interesting pod/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 20:01:22.618339 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:22.617955 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 20:01:23.534665 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.534640 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 20:01:23.609948 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.609913 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279367f7-7950-4742-b1d3-d6f65a39b4ce-istiod-ca-cert\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610127 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.609960 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-podinfo\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610127 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610010 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-envoy\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610127 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610029 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-data\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610127 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610047 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-token\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610351 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610150 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xg6b\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-kube-api-access-8xg6b\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610351 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610237 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-socket\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610351 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610279 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-certs\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610351 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610303 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-credential-socket\") pod \"279367f7-7950-4742-b1d3-d6f65a39b4ce\" (UID: \"279367f7-7950-4742-b1d3-d6f65a39b4ce\") " Aug 05 20:01:23.610543 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610314 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/279367f7-7950-4742-b1d3-d6f65a39b4ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 20:01:23.610543 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610419 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:23.610654 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610592 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:23.610708 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610653 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:23.610708 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610657 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-data\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.610708 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610674 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:23.610708 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.610685 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/279367f7-7950-4742-b1d3-d6f65a39b4ce-istiod-ca-cert\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.612326 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.612298 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-kube-api-access-8xg6b" (OuterVolumeSpecName: "kube-api-access-8xg6b") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "kube-api-access-8xg6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 20:01:23.612485 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.612464 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 20:01:23.612679 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.612654 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Aug 05 20:01:23.612679 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.612659 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "279367f7-7950-4742-b1d3-d6f65a39b4ce" (UID: "279367f7-7950-4742-b1d3-d6f65a39b4ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 20:01:23.711346 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.711304 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.711346 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.711339 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-workload-certs\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.711346 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.711351 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-credential-socket\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.711873 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.711359 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-podinfo\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.711873 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.711369 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-envoy\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.711873 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.711377 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-istio-token\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.711873 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.711385 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xg6b\" (UniqueName: \"kubernetes.io/projected/279367f7-7950-4742-b1d3-d6f65a39b4ce-kube-api-access-8xg6b\") on node \"ip-10-0-131-134.ec2.internal\" DevicePath \"\"" Aug 05 20:01:23.788126 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.788091 2578 generic.go:356] "Generic (PLEG): container finished" podID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerID="74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd" exitCode=0 Aug 05 20:01:23.788126 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.788132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" event={"ID":"279367f7-7950-4742-b1d3-d6f65a39b4ce","Type":"ContainerDied","Data":"74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd"} Aug 05 20:01:23.788350 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.788144 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" Aug 05 20:01:23.788350 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.788177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57" event={"ID":"279367f7-7950-4742-b1d3-d6f65a39b4ce","Type":"ContainerDied","Data":"9d3391a9ef14e8d6760c62494cd9dee519e50115b4174626420352315bed076e"} Aug 05 20:01:23.788350 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.788200 2578 scope.go:117] "RemoveContainer" containerID="74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd" Aug 05 20:01:23.798266 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.798246 2578 scope.go:117] "RemoveContainer" containerID="afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62" Aug 05 20:01:23.807469 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.807435 2578 scope.go:117] "RemoveContainer" containerID="74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd" Aug 05 20:01:23.807813 ip-10-0-131-134 kubenswrapper[2578]: E0805 20:01:23.807789 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd\": container with ID starting with 74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd not found: ID does not exist" containerID="74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd" Aug 05 20:01:23.807873 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.807828 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd"} err="failed to get container status \"74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd\": rpc error: code = NotFound desc = could not find container \"74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd\": container with ID starting with 74253d26f07cf7d706f45dafa155e0c27309524f7cac648b6746ad81e182f9dd not found: ID does not exist" Aug 05 20:01:23.807873 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.807848 2578 scope.go:117] "RemoveContainer" containerID="afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62" Aug 05 20:01:23.808123 ip-10-0-131-134 kubenswrapper[2578]: E0805 20:01:23.808099 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62\": container with ID starting with afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62 not found: ID does not exist" containerID="afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62" Aug 05 20:01:23.808245 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.808186 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62"} err="failed to get container status \"afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62\": rpc error: code = NotFound desc = could not find container \"afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62\": container with ID starting with afd4b03cef62a108097018c9730400b0782b0556491d0ce0c80b191bce00ec62 not found: ID does not exist" Aug 05 20:01:23.810776 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.810735 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57"] Aug 05 20:01:23.815625 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.815597 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1df35a-openshift-default-54b6fc4964-scx57"] Aug 05 20:01:23.936258 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:23.936172 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w47bn_5d95a646-511a-4535-a12e-47e8f8c0eb3b/manager/0.log" Aug 05 20:01:24.047089 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:24.047041 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jmbq7_a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8/manager/0.log" Aug 05 20:01:24.279939 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:24.279856 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9fdgf_2921cc43-3457-4eb8-8fa4-3e736f01b6f4/server/0.log" Aug 05 20:01:24.395161 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:24.395118 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wfz5w_fcfe9f9c-c9d6-4247-a62e-93ae5d987975/manager/0.log" Aug 05 20:01:24.537866 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:24.537781 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" path="/var/lib/kubelet/pods/279367f7-7950-4742-b1d3-d6f65a39b4ce/volumes" Aug 05 20:01:24.730014 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:24.729981 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-h8cmr_330a15fc-05a9-43cd-9252-2e5b7a38a9c7/copy-manifests/0.log" Aug 05 20:01:24.743085 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:24.743056 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-h8cmr_330a15fc-05a9-43cd-9252-2e5b7a38a9c7/manager/0.log" Aug 05 20:01:26.312768 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:26.312707 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-c2r2p_b3a517e6-44e3-455b-9fcb-62824e95b506/manager/0.log" Aug 05 20:01:26.424303 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:26.424276 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-f5z4m_7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7/manager/0.log" Aug 05 20:01:26.532250 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:26.532217 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-q56vs_000beaea-4921-44f3-af85-d37df3c58177/kuadrant-console-plugin/0.log" Aug 05 20:01:26.866310 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:26.866271 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-4cftg_e259fc6f-2c89-4098-b199-66474dc4e5a0/manager/0.log" Aug 05 20:01:27.204059 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:27.203984 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cp6j45_66414737-9c6f-4d6e-9010-05de5acd7884/istio-proxy/0.log" Aug 05 20:01:27.425420 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:27.425385 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5556bf7c7c-j94d5_8122e435-32ab-434a-914d-835ac22f1007/kube-auth-proxy/0.log" Aug 05 20:01:27.636916 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:27.636886 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-l4g8h_200a5a92-ba21-4a0f-a251-7aec0d369937/istio-proxy/1.log" Aug 05 20:01:27.748964 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:27.748934 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zsg8w_589435c3-d533-4ce1-b2da-d6e9c2646d08/payload-pre-processing/0.log" Aug 05 20:01:27.863647 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:27.863613 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gfg5_c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9/payload-processing/0.log" Aug 05 20:01:27.968970 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:27.968895 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f999d9fc6-fwg8z_c99440c4-09ca-4187-b83d-dedadb8ae375/router/0.log" Aug 05 20:01:28.404946 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:28.404915 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gghfl_b67e20ed-611f-4f24-97a6-478004bacf1c/main/0.log" Aug 05 20:01:28.713048 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:28.712969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dfmrh_c036955e-d811-46df-aa73-8560108eb290/main/0.log" Aug 05 20:01:36.875372 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:36.875335 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fdhbz_6d01c6b1-66c2-42ea-aa85-82e940e1cd30/global-pull-secret-syncer/0.log" Aug 05 20:01:37.004031 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:37.003996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g85lw_a1143878-16e2-46b6-b88f-57c719b461e0/konnectivity-agent/0.log" Aug 05 20:01:37.060699 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:37.060667 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-134.ec2.internal_12cbc8a05d620b6aab5e8ac03ce312fa/haproxy/0.log" Aug 05 20:01:42.436675 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:42.436641 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-c2r2p_b3a517e6-44e3-455b-9fcb-62824e95b506/manager/0.log" Aug 05 20:01:42.462392 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:42.462362 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-f5z4m_7b3447a1-bd73-49e8-a4f0-6e1c9a7b4ae7/manager/0.log" Aug 05 20:01:42.490023 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:42.489994 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-q56vs_000beaea-4921-44f3-af85-d37df3c58177/kuadrant-console-plugin/0.log" Aug 05 20:01:42.735701 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:42.735610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-4cftg_e259fc6f-2c89-4098-b199-66474dc4e5a0/manager/0.log" Aug 05 20:01:44.435815 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:44.431254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-h9nc8_48138494-3649-4697-9f11-fe42048dcd4f/cluster-monitoring-operator/0.log" Aug 05 20:01:44.708501 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:44.708419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pdv27_8025291c-3df4-405e-9d34-2f6e52207c6a/node-exporter/0.log" Aug 05 20:01:44.741259 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:44.741231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pdv27_8025291c-3df4-405e-9d34-2f6e52207c6a/kube-rbac-proxy/0.log" Aug 05 20:01:44.762432 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:44.762406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pdv27_8025291c-3df4-405e-9d34-2f6e52207c6a/init-textfile/0.log" Aug 05 20:01:46.666226 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:46.666188 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-xcthw_cc944e59-9f03-4a32-bb18-b7ccf0301847/networking-console-plugin/0.log" Aug 05 20:01:47.104324 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.104288 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l"] Aug 05 20:01:47.104821 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.104798 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" Aug 05 20:01:47.105003 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.104979 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" Aug 05 20:01:47.105106 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105016 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" Aug 05 20:01:47.105106 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105026 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" Aug 05 20:01:47.105106 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105066 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" Aug 05 20:01:47.105106 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105072 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" Aug 05 20:01:47.105106 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105082 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" Aug 05 20:01:47.105106 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105090 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" Aug 05 20:01:47.105106 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105101 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" Aug 05 20:01:47.105106 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105109 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105118 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6225a9-faa1-43e8-b4b9-b4a547ad4633" containerName="payload-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105123 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6225a9-faa1-43e8-b4b9-b4a547ad4633" containerName="payload-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105133 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb" containerName="payload-pre-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105138 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb" containerName="payload-pre-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105146 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105153 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105164 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6822ae50-1e60-427a-aa05-8af4b7a04416" containerName="payload-pre-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105170 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6822ae50-1e60-427a-aa05-8af4b7a04416" containerName="payload-pre-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105266 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="af6a5081-75e3-47d5-9f8a-87ee8de10134" containerName="istio-proxy" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105277 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bdc8bd0-63fa-4ab2-bbba-60ff18d0c9e1" containerName="istio-proxy" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105282 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6822ae50-1e60-427a-aa05-8af4b7a04416" containerName="payload-pre-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105288 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b6225a9-faa1-43e8-b4b9-b4a547ad4633" containerName="payload-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105293 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce4ac60-fcdd-4a34-a10b-faf20b2a34fb" containerName="payload-pre-processing" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105298 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" Aug 05 20:01:47.105359 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.105305 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="279367f7-7950-4742-b1d3-d6f65a39b4ce" containerName="istio-proxy" Aug 05 20:01:47.108245 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.108229 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.110891 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.110872 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vfb\"/\"openshift-service-ca.crt\"" Aug 05 20:01:47.112015 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.111996 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vfb\"/\"kube-root-ca.crt\"" Aug 05 20:01:47.112152 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.112001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w6vfb\"/\"default-dockercfg-zvhjt\"" Aug 05 20:01:47.118376 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.118345 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l"] Aug 05 20:01:47.235933 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.235898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-lib-modules\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.236110 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.235953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67x8j\" (UniqueName: \"kubernetes.io/projected/010969bf-6d55-451e-874d-6ccd727edab3-kube-api-access-67x8j\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.236110 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.236023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-podres\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.236110 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.236086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-proc\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.236230 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.236142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-sys\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.337659 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.337625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-sys\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.337868 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.337687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-lib-modules\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.337868 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.337734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67x8j\" (UniqueName: \"kubernetes.io/projected/010969bf-6d55-451e-874d-6ccd727edab3-kube-api-access-67x8j\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.338008 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.337994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-podres\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.338062 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.337782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-sys\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.338062 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.337884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-lib-modules\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.338062 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.338036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-proc\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.338200 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.338119 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-proc\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.338200 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.338131 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/010969bf-6d55-451e-874d-6ccd727edab3-podres\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.350762 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.350728 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67x8j\" (UniqueName: \"kubernetes.io/projected/010969bf-6d55-451e-874d-6ccd727edab3-kube-api-access-67x8j\") pod \"perf-node-gather-daemonset-4d55l\" (UID: \"010969bf-6d55-451e-874d-6ccd727edab3\") " pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.372030 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.371954 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/1.log" Aug 05 20:01:47.377363 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.377340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-mzxn4_a4e3ee9a-4a8a-47b7-8303-56eefa1f9937/console-operator/2.log" Aug 05 20:01:47.419698 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.419661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.560817 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.560788 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l"] Aug 05 20:01:47.562496 ip-10-0-131-134 kubenswrapper[2578]: W0805 20:01:47.562462 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod010969bf_6d55_451e_874d_6ccd727edab3.slice/crio-55e06997ce94fdb2fe7e51fbb6d348ac53674a15f3854e8ce30e2edea748bf3a WatchSource:0}: Error finding container 55e06997ce94fdb2fe7e51fbb6d348ac53674a15f3854e8ce30e2edea748bf3a: Status 404 returned error can't find the container with id 55e06997ce94fdb2fe7e51fbb6d348ac53674a15f3854e8ce30e2edea748bf3a Aug 05 20:01:47.925286 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.925187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" event={"ID":"010969bf-6d55-451e-874d-6ccd727edab3","Type":"ContainerStarted","Data":"13453358a1440a70a0ac7ddf59531d1e6ca0b7887c4f4e101a38c07f299d9862"} Aug 05 20:01:47.925687 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.925284 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:47.925687 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.925321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" event={"ID":"010969bf-6d55-451e-874d-6ccd727edab3","Type":"ContainerStarted","Data":"55e06997ce94fdb2fe7e51fbb6d348ac53674a15f3854e8ce30e2edea748bf3a"} Aug 05 20:01:47.946959 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:47.946905 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" podStartSLOduration=0.946890243 podStartE2EDuration="946.890243ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 20:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 20:01:47.945328813 +0000 UTC m=+3633.965391913" watchObservedRunningTime="2026-08-05 20:01:47.946890243 +0000 UTC m=+3633.966953290" Aug 05 20:01:48.010333 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:48.010295 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-fwkqn_6af50039-0f90-4d9e-b7b1-0e12093f48bf/download-server/0.log" Aug 05 20:01:48.696093 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:48.696052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-z6xkr_fbaca6ca-4bd0-46bd-a86a-10ba2322cb4e/volume-data-source-validator/0.log" Aug 05 20:01:49.773398 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:49.773361 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qmmbg_d48840be-5068-46be-aa12-0ea789eb0a66/dns/0.log" Aug 05 20:01:49.796261 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:49.796230 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qmmbg_d48840be-5068-46be-aa12-0ea789eb0a66/kube-rbac-proxy/0.log" Aug 05 20:01:49.843638 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:49.843605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j9m66_f8b682b2-bedb-4dbf-a585-50cccff11ef4/dns-node-resolver/0.log" Aug 05 20:01:50.425036 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:50.424985 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-64mxw_5c0e56e0-d8f4-4537-91b2-97035dbbc26e/node-ca/0.log" Aug 05 20:01:51.375706 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:51.375675 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cp6j45_66414737-9c6f-4d6e-9010-05de5acd7884/istio-proxy/0.log" Aug 05 20:01:51.571097 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:51.571064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5556bf7c7c-j94d5_8122e435-32ab-434a-914d-835ac22f1007/kube-auth-proxy/0.log" Aug 05 20:01:51.632082 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:51.631999 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-l4g8h_200a5a92-ba21-4a0f-a251-7aec0d369937/istio-proxy/0.log" Aug 05 20:01:51.639303 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:51.639273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-l4g8h_200a5a92-ba21-4a0f-a251-7aec0d369937/istio-proxy/1.log" Aug 05 20:01:51.672139 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:51.672105 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zsg8w_589435c3-d533-4ce1-b2da-d6e9c2646d08/payload-pre-processing/0.log" Aug 05 20:01:51.702452 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:51.702422 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gfg5_c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9/payload-processing/0.log" Aug 05 20:01:51.724255 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:51.724231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f999d9fc6-fwg8z_c99440c4-09ca-4187-b83d-dedadb8ae375/router/0.log" Aug 05 20:01:52.537906 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:52.537873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fj2w_d9333206-a382-40f1-90ef-bfda175ba53d/serve-healthcheck-canary/0.log" Aug 05 20:01:53.034495 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:53.034465 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-kfhkc_00857821-0bae-44c3-a656-0033cc3c0cfc/insights-operator/0.log" Aug 05 20:01:53.035875 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:53.035856 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-kfhkc_00857821-0bae-44c3-a656-0033cc3c0cfc/insights-operator/1.log" Aug 05 20:01:53.191922 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:53.191890 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5qvd_2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6/kube-rbac-proxy/0.log" Aug 05 20:01:53.213923 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:53.213897 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5qvd_2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6/exporter/0.log" Aug 05 20:01:53.238582 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:53.238547 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5qvd_2f1b1b68-5c3e-4e67-ab88-96f0ca9f72c6/extractor/0.log" Aug 05 20:01:53.941677 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:53.941650 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w6vfb/perf-node-gather-daemonset-4d55l" Aug 05 20:01:55.305200 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:55.305169 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w47bn_5d95a646-511a-4535-a12e-47e8f8c0eb3b/manager/0.log" Aug 05 20:01:55.536370 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:55.536329 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jmbq7_a9eb8e05-83e4-45ff-9a62-6e8a72fb40b8/manager/0.log" Aug 05 20:01:55.723981 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:55.723900 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9fdgf_2921cc43-3457-4eb8-8fa4-3e736f01b6f4/server/0.log" Aug 05 20:01:55.804787 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:55.804761 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wfz5w_fcfe9f9c-c9d6-4247-a62e-93ae5d987975/manager/0.log" Aug 05 20:01:56.002140 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:56.002046 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-h8cmr_330a15fc-05a9-43cd-9252-2e5b7a38a9c7/manager/0.log" Aug 05 20:01:56.019261 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:56.019230 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74df9bd579-h8cmr_330a15fc-05a9-43cd-9252-2e5b7a38a9c7/copy-manifests/0.log" Aug 05 20:01:57.738671 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:57.738571 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cp6j45_66414737-9c6f-4d6e-9010-05de5acd7884/istio-proxy/0.log" Aug 05 20:01:57.921345 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:57.921314 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5556bf7c7c-j94d5_8122e435-32ab-434a-914d-835ac22f1007/kube-auth-proxy/0.log" Aug 05 20:01:57.954770 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:57.954716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-l4g8h_200a5a92-ba21-4a0f-a251-7aec0d369937/istio-proxy/0.log" Aug 05 20:01:57.961619 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:57.961589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-l4g8h_200a5a92-ba21-4a0f-a251-7aec0d369937/istio-proxy/1.log" Aug 05 20:01:57.981271 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:57.981245 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zsg8w_589435c3-d533-4ce1-b2da-d6e9c2646d08/payload-pre-processing/0.log" Aug 05 20:01:58.001128 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:58.001047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gfg5_c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9/payload-processing/0.log" Aug 05 20:01:58.017412 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:58.017386 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f999d9fc6-fwg8z_c99440c4-09ca-4187-b83d-dedadb8ae375/router/0.log" Aug 05 20:01:59.429069 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:59.429027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cp6j45_66414737-9c6f-4d6e-9010-05de5acd7884/istio-proxy/0.log" Aug 05 20:01:59.604891 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:59.604859 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5556bf7c7c-j94d5_8122e435-32ab-434a-914d-835ac22f1007/kube-auth-proxy/0.log" Aug 05 20:01:59.642825 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:59.642789 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-l4g8h_200a5a92-ba21-4a0f-a251-7aec0d369937/istio-proxy/0.log" Aug 05 20:01:59.649353 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:59.649319 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-l4g8h_200a5a92-ba21-4a0f-a251-7aec0d369937/istio-proxy/1.log" Aug 05 20:01:59.671429 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:59.671387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zsg8w_589435c3-d533-4ce1-b2da-d6e9c2646d08/payload-pre-processing/0.log" Aug 05 20:01:59.695574 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:59.695467 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gfg5_c67e10b3-6593-4fb7-a6e8-2b5d37d9e4f9/payload-processing/0.log" Aug 05 20:01:59.712507 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:01:59.712480 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f999d9fc6-fwg8z_c99440c4-09ca-4187-b83d-dedadb8ae375/router/0.log" Aug 05 20:02:02.427278 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:02.427246 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-6xjp8_aa2ec381-d183-4466-980d-ee0ff6a83457/migrator/0.log" Aug 05 20:02:02.451226 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:02.451196 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-6xjp8_aa2ec381-d183-4466-980d-ee0ff6a83457/graceful-termination/0.log" Aug 05 20:02:02.794461 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:02.794359 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-rch4b_bf6127ab-0a56-4428-89a1-d982e927322f/kube-storage-version-migrator-operator/1.log" Aug 05 20:02:02.795216 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:02.795199 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-rch4b_bf6127ab-0a56-4428-89a1-d982e927322f/kube-storage-version-migrator-operator/0.log" Aug 05 20:02:03.758939 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:03.758849 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4n6rc_832f67d7-7e03-4676-99ba-c36f8a94d0fe/kube-multus/0.log" Aug 05 20:02:03.960286 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:03.960257 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzl76_90798647-ba8c-4c35-9b74-4daf31a0e798/kube-multus-additional-cni-plugins/0.log" Aug 05 20:02:03.980356 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:03.980320 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzl76_90798647-ba8c-4c35-9b74-4daf31a0e798/egress-router-binary-copy/0.log" Aug 05 20:02:04.000702 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:04.000674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzl76_90798647-ba8c-4c35-9b74-4daf31a0e798/cni-plugins/0.log" Aug 05 20:02:04.022527 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:04.022432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzl76_90798647-ba8c-4c35-9b74-4daf31a0e798/bond-cni-plugin/0.log" Aug 05 20:02:04.041886 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:04.041858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzl76_90798647-ba8c-4c35-9b74-4daf31a0e798/routeoverride-cni/0.log" Aug 05 20:02:04.062135 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:04.062108 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzl76_90798647-ba8c-4c35-9b74-4daf31a0e798/whereabouts-cni-bincopy/0.log" Aug 05 20:02:04.087904 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:04.087878 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nzl76_90798647-ba8c-4c35-9b74-4daf31a0e798/whereabouts-cni/0.log" Aug 05 20:02:04.362379 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:04.362344 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g727w_d81923d9-f4de-436a-a04e-b6276d577090/network-metrics-daemon/0.log" Aug 05 20:02:04.393457 ip-10-0-131-134 kubenswrapper[2578]: I0805 20:02:04.393421 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g727w_d81923d9-f4de-436a-a04e-b6276d577090/kube-rbac-proxy/0.log"